[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:48:45 dist-test-slave-7lbf krb5kdc[12884](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:48:45 dist-test-slave-7lbf krb5kdc[12884](info): set up 2 sockets
Aug 11 06:48:45 dist-test-slave-7lbf krb5kdc[12884](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 06:48:47.476100 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.797s user 0.006s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:48:47 dist-test-slave-7lbf krb5kdc[12884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:48:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:48:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:48:47.663965 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:34295
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:34295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:48.059635 12902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:48.060046 12902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:48.060195 12902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:48.067984 12902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:48:48.068082 12902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:48.068157 12902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:48.068275 12902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:48:48.068342 12902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:48:48.078994 12902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:34295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:34295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:48.081429 12902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:48.083518 12902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:48.104555 12910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:48.104573 12909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:48.107682 12913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:48.109078 12902 server_base.cc:1034] running on GCE node
I20260811 06:48:48.110577 12902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:48.113096 12902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:48.114405 12902 hybrid_clock.cc:648] HybridClock initialized: now 1786430928114327 us; error 102 us; skew 500 ppm
I20260811 06:48:48.115015 12902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:48 dist-test-slave-7lbf krb5kdc[12884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430928, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:48.119419 12902 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:48:48.122372 12902 webserver.cc:460] Webserver started at http://127.12.145.62:44905/ using document root <none> and password file <none>
I20260811 06:48:48.123577 12902 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:48.123711 12902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:48.124250 12902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:48.128750 12902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "5f2983b0587b4f0996e3069eb003a4f3"
format_stamp: "Formatted at 2026-08-11 06:48:48 on dist-test-slave-7lbf"
server_key: "1b95b860630ec0a60052cb0f21e641df"
server_key_iv: "0721839d03b251f60d33b1ae7d2d20c7"
server_key_version: "encryptionkey@0"
I20260811 06:48:48.129805 12902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "5f2983b0587b4f0996e3069eb003a4f3"
format_stamp: "Formatted at 2026-08-11 06:48:48 on dist-test-slave-7lbf"
server_key: "1b95b860630ec0a60052cb0f21e641df"
server_key_iv: "0721839d03b251f60d33b1ae7d2d20c7"
server_key_version: "encryptionkey@0"
I20260811 06:48:48.138856 12902 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260811 06:48:48.145176 12925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:48.147583 12902 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.001s
I20260811 06:48:48.147897 12902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "5f2983b0587b4f0996e3069eb003a4f3"
format_stamp: "Formatted at 2026-08-11 06:48:48 on dist-test-slave-7lbf"
server_key: "1b95b860630ec0a60052cb0f21e641df"
server_key_iv: "0721839d03b251f60d33b1ae7d2d20c7"
server_key_version: "encryptionkey@0"
I20260811 06:48:48.148145 12902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:48.167856 12902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:48.172890 12902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:48.173264 12902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:48.198338 13012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:34295 every 8 connection(s)
I20260811 06:48:48.198343 12902 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:34295
I20260811 06:48:48.200973 12902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:48:48.203277 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 12902
I20260811 06:48:48.203653 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:48:48.206133 12868 external_mini_cluster.cc:1428] Setting key 31bf924a4924ea8c2a78e1250bcc6bf5
I20260811 06:48:48.209499 13014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:48.226148 13014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3: Bootstrap starting.
I20260811 06:48:48.233232 13014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:48.235481 13014 log.cc:824] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3: Log is configured to *not* fsync() on all Append() calls
I20260811 06:48:48.240026 13014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3: No bootstrap required, opened a new log
Aug 11 06:48:48 dist-test-slave-7lbf krb5kdc[12884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:48.250370 13014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f2983b0587b4f0996e3069eb003a4f3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34295 } }
I20260811 06:48:48.250946 13014 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:48.251161 13014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2983b0587b4f0996e3069eb003a4f3, State: Initialized, Role: FOLLOWER
I20260811 06:48:48.252480 13014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f2983b0587b4f0996e3069eb003a4f3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34295 } }
I20260811 06:48:48.252947 13014 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:48:48.253312 13014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:48:48.253715 13014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:48.255681 13016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:48.212654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57200 (local address 127.12.145.62:34295)
0811 06:48:48.214190 (+ 1536us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:48.214210 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:48.217560 (+ 3350us) server_negotiation.cc:407] Connection header received
0811 06:48:48.228245 (+ 10685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:48.228335 (+ 90us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:48.229053 (+ 718us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:48.229609 (+ 556us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:48.232862 (+ 3253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:48.235193 (+ 2331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:48.237404 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:48.238492 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:48.238753 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:48.245112 (+ 6359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:48.245200 (+ 88us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:48.245234 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:48.245272 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:48.249142 (+ 3870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:48.250213 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:48.250220 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:48.250225 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:48.250488 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:48.251049 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:48.251055 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:48.251059 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:48.251987 (+ 928us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:48.252305 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:48.253747 (+ 1442us) server_negotiation.cc:299] Negotiation successful
0811 06:48:48.254139 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1010,"thread_start_us":384,"threads_started":1}
I20260811 06:48:48.303133 13014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f2983b0587b4f0996e3069eb003a4f3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34295 } }
I20260811 06:48:48.304519 13014 leader_election.cc:302] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f2983b0587b4f0996e3069eb003a4f3; no voters:
I20260811 06:48:48.305569 13014 leader_election.cc:288] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:48:48.305863 13020 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:48:48.308724 13020 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [term 1 LEADER]: Becoming Leader. State: Replica: 5f2983b0587b4f0996e3069eb003a4f3, State: Running, Role: LEADER
I20260811 06:48:48.309501 13014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:48:48.309651 13020 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f2983b0587b4f0996e3069eb003a4f3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34295 } }
I20260811 06:48:48.316465 13023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f2983b0587b4f0996e3069eb003a4f3. Latest consensus state: current_term: 1 leader_uuid: "5f2983b0587b4f0996e3069eb003a4f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f2983b0587b4f0996e3069eb003a4f3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34295 } } }
I20260811 06:48:48.316548 13022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f2983b0587b4f0996e3069eb003a4f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f2983b0587b4f0996e3069eb003a4f3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34295 } } }
I20260811 06:48:48.316968 13048 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 06:48:48.317214 13022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [sys.catalog]: This master's current role is: LEADER
I20260811 06:48:48.316972 13023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3 [sys.catalog]: This master's current role is: LEADER
I20260811 06:48:48.319751 13051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:48:48.327240 13051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:48:48.341863 13051 catalog_manager.cc:1347] Generated new cluster ID: 46fd1d90c7d244858ebbcb61f38f2600
I20260811 06:48:48.342165 13051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:48:48.361775 13051 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:48:48.363973 13051 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:48:48.376441 13051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f2983b0587b4f0996e3069eb003a4f3: Generated new TSK 0
I20260811 06:48:48.377776 13051 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
W20260811 06:48:49.570464 12868 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.12.145.1: real 1.174s user 0.002s sys 0.014s
I20260811 06:48:49.571703 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:34295
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:49.906467 13058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:49.906726 13058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:49.906857 13058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:49.914429 13058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:49.914541 13058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:49.914696 13058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:48:49.924382 13058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:34295
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:49.925700 13058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:49.927013 13058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:49.940797 13069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:49.940923 13067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:49.940896 13066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:49.941738 13058 server_base.cc:1034] running on GCE node
I20260811 06:48:49.942309 13058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:49.943208 13058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:49.944454 13058 hybrid_clock.cc:648] HybridClock initialized: now 1786430929944381 us; error 51 us; skew 500 ppm
I20260811 06:48:49.944841 13058 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:49 dist-test-slave-7lbf krb5kdc[12884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430929, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:49.948204 13058 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:48:49.949708 13058 webserver.cc:460] Webserver started at http://127.12.145.1:45551/ using document root <none> and password file <none>
I20260811 06:48:49.950470 13058 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:49.950623 13058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:49.950961 13058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:49.954192 13058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "9b2fc8dc8899420a8e15f3ca24353810"
format_stamp: "Formatted at 2026-08-11 06:48:49 on dist-test-slave-7lbf"
server_key: "08b88966e90273277d90a8771c68a4b5"
server_key_iv: "14a916b44df3b9c0d5d5f77796f57523"
server_key_version: "encryptionkey@0"
I20260811 06:48:49.955113 13058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "9b2fc8dc8899420a8e15f3ca24353810"
format_stamp: "Formatted at 2026-08-11 06:48:49 on dist-test-slave-7lbf"
server_key: "08b88966e90273277d90a8771c68a4b5"
server_key_iv: "14a916b44df3b9c0d5d5f77796f57523"
server_key_version: "encryptionkey@0"
I20260811 06:48:49.961093 13058 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 06:48:49.964807 13077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:49.966287 13058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:48:49.966462 13058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "9b2fc8dc8899420a8e15f3ca24353810"
format_stamp: "Formatted at 2026-08-11 06:48:49 on dist-test-slave-7lbf"
server_key: "08b88966e90273277d90a8771c68a4b5"
server_key_iv: "14a916b44df3b9c0d5d5f77796f57523"
server_key_version: "encryptionkey@0"
I20260811 06:48:49.966663 13058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:49.982326 13058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:49.986120 13058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:49.986380 13058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:49.987524 13058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:48:49.989270 13058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:48:49.989351 13058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:49.989557 13058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:48:49.989621 13058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 06:48:50.030622 13058 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:38175
I20260811 06:48:50.030655 13256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:38175 every 8 connection(s)
I20260811 06:48:50.032008 13058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:48:50.039448 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 13058
I20260811 06:48:50.039630 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:48:50.040292 12868 external_mini_cluster.cc:1428] Setting key 2292a34cc328590d57ba825d36428e9f
Aug 11 06:48:50 dist-test-slave-7lbf krb5kdc[12884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430929, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:50.053465 13259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:50.035609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:33569 (local address 127.12.145.62:34295)
0811 06:48:50.036135 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:50.036140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:50.036928 (+ 788us) server_negotiation.cc:407] Connection header received
0811 06:48:50.038787 (+ 1859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:50.038793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:50.038883 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:50.038985 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:50.040629 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:50.041617 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:50.043187 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:50.043571 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:50.043678 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:50.047240 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:50.047246 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:50.047251 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:50.047314 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:50.050186 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:50.051071 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:50.051075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:50.051078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:50.051214 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:50.051645 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:50.051648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:50.051650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:50.051906 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:50.052038 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:50.052889 (+ 851us) server_negotiation.cc:299] Negotiation successful
0811 06:48:50.053110 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":311,"threads_started":1}
I20260811 06:48:50.054745 13263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:50.036007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:34295 (local address 127.12.145.1:33569)
0811 06:48:50.036753 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:50.036797 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:50.038517 (+ 1720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:50.039252 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:50.039261 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:50.039852 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:50.040451 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:50.040470 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:50.041770 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:50.041774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:50.043050 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:50.043062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:50.043784 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:50.043791 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:50.044017 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:50.044658 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:50.044679 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:50.047003 (+ 2324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:50.050319 (+ 3316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:50.050327 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:50.050344 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:50.050939 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:50.051316 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:50.051321 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:50.051325 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:50.051553 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:50.052029 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:50.052036 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:50.052435 (+ 399us) client_negotiation.cc:769] Sending connection context
0811 06:48:50.052798 (+ 363us) client_negotiation.cc:240] Negotiation successful
0811 06:48:50.053340 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":310,"threads_started":1}
I20260811 06:48:50.056411 13257 heartbeater.cc:347] Connected to a master server at 127.12.145.62:34295
I20260811 06:48:50.056953 13257 heartbeater.cc:464] Registering TS with master...
I20260811 06:48:50.058065 13257 heartbeater.cc:511] Master 127.12.145.62:34295 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
I20260811 06:48:50.062633 12957 ts_manager.cc:194] Registered new tserver with Master: 9b2fc8dc8899420a8e15f3ca24353810 (127.12.145.1:38175)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
I20260811 06:48:50.065243 12957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:33569
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:48:50.088025 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:34295
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:50.417294 13267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:50.417618 13267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:50.417768 13267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:50.424979 13267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:50.425159 13267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:50.425326 13267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:48:50.435246 13267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:34295
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:50.436496 13267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:50.437846 13267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:50.451262 13274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:50.451268 13279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:50.451274 13276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:50.452471 13267 server_base.cc:1034] running on GCE node
I20260811 06:48:50.453078 13267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:50.454170 13267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:50.455366 13267 hybrid_clock.cc:648] HybridClock initialized: now 1786430930455320 us; error 36 us; skew 500 ppm
I20260811 06:48:50.455657 13267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:50 dist-test-slave-7lbf krb5kdc[12884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430930, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:50.458935 13267 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:48:50.460593 13267 webserver.cc:460] Webserver started at http://127.12.145.2:38871/ using document root <none> and password file <none>
I20260811 06:48:50.461270 13267 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:50.461386 13267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:50.461793 13267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:50.464929 13267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "117b510081af436c8aec06ebcc5f3a8f"
format_stamp: "Formatted at 2026-08-11 06:48:50 on dist-test-slave-7lbf"
server_key: "93a396cd3142ce42190cda1f9d19e6bd"
server_key_iv: "0b2e16cbf9eae2d2462294803d432cba"
server_key_version: "encryptionkey@0"
I20260811 06:48:50.465946 13267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "117b510081af436c8aec06ebcc5f3a8f"
format_stamp: "Formatted at 2026-08-11 06:48:50 on dist-test-slave-7lbf"
server_key: "93a396cd3142ce42190cda1f9d19e6bd"
server_key_iv: "0b2e16cbf9eae2d2462294803d432cba"
server_key_version: "encryptionkey@0"
I20260811 06:48:50.471524 13267 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 06:48:50.475499 13289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:50.476873 13267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:48:50.477039 13267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "117b510081af436c8aec06ebcc5f3a8f"
format_stamp: "Formatted at 2026-08-11 06:48:50 on dist-test-slave-7lbf"
server_key: "93a396cd3142ce42190cda1f9d19e6bd"
server_key_iv: "0b2e16cbf9eae2d2462294803d432cba"
server_key_version: "encryptionkey@0"
I20260811 06:48:50.477255 13267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:50.491168 13267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:50.495647 13267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:50.495951 13267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:50.497018 13267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:48:50.498484 13267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:48:50.498574 13267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:50.498706 13267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:48:50.498773 13267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:50.538395 13267 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:37383
I20260811 06:48:50.538471 13470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:37383 every 8 connection(s)
I20260811 06:48:50.539835 13267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:48:50.544121 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 13267
I20260811 06:48:50.544334 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:48:50.544821 12868 external_mini_cluster.cc:1428] Setting key b989bce71b68e4683326f035b733cc97
Aug 11 06:48:50 dist-test-slave-7lbf krb5kdc[12884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430930, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:50.561105 13259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:50.542617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:38839 (local address 127.12.145.62:34295)
0811 06:48:50.542792 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:50.542797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:50.544059 (+ 1262us) server_negotiation.cc:407] Connection header received
0811 06:48:50.546191 (+ 2132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:50.546195 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:50.546303 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:50.546400 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:50.548165 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:50.548876 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:50.550509 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:50.550947 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:50.551075 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:50.554879 (+ 3804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:50.554888 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:50.554892 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:50.554929 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:50.557741 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:50.558674 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:50.558678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:50.558681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:50.558851 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:50.559354 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:50.559357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:50.559359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:50.559628 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:50.559744 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:50.560650 (+ 906us) server_negotiation.cc:299] Negotiation successful
0811 06:48:50.560842 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 06:48:50.562548 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:50.543042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:34295 (local address 127.12.145.2:38839)
0811 06:48:50.543895 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:50.543939 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:50.545890 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:50.546684 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:50.546693 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:50.547337 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:50.547985 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:50.548006 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:50.549029 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:50.549033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:50.550370 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:50.550383 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:50.551186 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:50.551195 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:50.551410 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:50.552042 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:50.552065 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:50.554596 (+ 2531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:50.557907 (+ 3311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:50.557915 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:50.557932 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:50.558517 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:50.558989 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:50.558994 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:50.558997 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:50.559253 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:50.559756 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:50.559764 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:50.560224 (+ 460us) client_negotiation.cc:769] Sending connection context
0811 06:48:50.560543 (+ 319us) client_negotiation.cc:240] Negotiation successful
0811 06:48:50.561114 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":424,"threads_started":1}
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
I20260811 06:48:50.564117 13471 heartbeater.cc:347] Connected to a master server at 127.12.145.62:34295
I20260811 06:48:50.564420 13471 heartbeater.cc:464] Registering TS with master...
I20260811 06:48:50.565266 13471 heartbeater.cc:511] Master 127.12.145.62:34295 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
I20260811 06:48:50.566839 12957 ts_manager.cc:194] Registered new tserver with Master: 117b510081af436c8aec06ebcc5f3a8f (127.12.145.2:37383)
I20260811 06:48:50.567924 12957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:38839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:48:50.588600 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:34295
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:50.924201 13482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:50.924484 13482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:50.924625 13482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:50.931973 13482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:50.932085 13482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:50.932237 13482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:48:50.942384 13482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:34295
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:50.943651 13482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:50.944977 13482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:50.961957 13495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:50.961910 13496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:50.961980 13498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:50.963459 13482 server_base.cc:1034] running on GCE node
I20260811 06:48:50.964136 13482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:50.965147 13482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:50.966382 13482 hybrid_clock.cc:648] HybridClock initialized: now 1786430930966318 us; error 39 us; skew 500 ppm
I20260811 06:48:50.966704 13482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:50 dist-test-slave-7lbf krb5kdc[12884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430930, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:50.973909 13482 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:48:50.975513 13482 webserver.cc:460] Webserver started at http://127.12.145.3:33271/ using document root <none> and password file <none>
I20260811 06:48:50.976269 13482 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:50.976387 13482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:50.976673 13482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:50.979776 13482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "772a9daea0b04406b229e7dd91013866"
format_stamp: "Formatted at 2026-08-11 06:48:50 on dist-test-slave-7lbf"
server_key: "2cec0cc9ee0d76b81dda84b5e2e2306d"
server_key_iv: "f5f0b8dd011de71204b7afb37aeec73f"
server_key_version: "encryptionkey@0"
I20260811 06:48:50.980584 13482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "772a9daea0b04406b229e7dd91013866"
format_stamp: "Formatted at 2026-08-11 06:48:50 on dist-test-slave-7lbf"
server_key: "2cec0cc9ee0d76b81dda84b5e2e2306d"
server_key_iv: "f5f0b8dd011de71204b7afb37aeec73f"
server_key_version: "encryptionkey@0"
I20260811 06:48:50.986311 13482 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260811 06:48:50.989727 13510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:50.991014 13482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:48:50.991168 13482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "772a9daea0b04406b229e7dd91013866"
format_stamp: "Formatted at 2026-08-11 06:48:50 on dist-test-slave-7lbf"
server_key: "2cec0cc9ee0d76b81dda84b5e2e2306d"
server_key_iv: "f5f0b8dd011de71204b7afb37aeec73f"
server_key_version: "encryptionkey@0"
I20260811 06:48:50.991350 13482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:51.031953 13482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:51.036319 13482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:51.036593 13482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:51.037616 13482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:48:51.039026 13482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:48:51.039103 13482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:51.039227 13482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:48:51.039280 13482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:51.069412 13257 heartbeater.cc:503] Master 127.12.145.62:34295 was elected leader, sending a full tablet report...
I20260811 06:48:51.075230 13482 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:43673
I20260811 06:48:51.075269 13698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:43673 every 8 connection(s)
I20260811 06:48:51.076453 13482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:48:51.085088 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 13482
I20260811 06:48:51.085254 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:48:51.085767 12868 external_mini_cluster.cc:1428] Setting key 06c626e3c4275c9237f0ae9fc8c81a47
Aug 11 06:48:51 dist-test-slave-7lbf krb5kdc[12884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430930, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:51.096984 13702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:51.078971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:39565 (local address 127.12.145.62:34295)
0811 06:48:51.079455 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:51.079459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:51.080535 (+ 1076us) server_negotiation.cc:407] Connection header received
0811 06:48:51.082553 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:51.082559 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:51.082641 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:51.082740 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:51.084258 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.085051 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.086919 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.087450 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.087564 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:51.091247 (+ 3683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:51.091252 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:51.091255 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:51.091289 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:51.093905 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.094636 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.094641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.094643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.094795 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.095254 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.095261 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.095265 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.095656 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:51.095791 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:51.096453 (+ 662us) server_negotiation.cc:299] Negotiation successful
0811 06:48:51.096641 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":266,"threads_started":1}
I20260811 06:48:51.097860 13703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:51.079601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:34295 (local address 127.12.145.3:39565)
0811 06:48:51.080375 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:51.080421 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:51.082283 (+ 1862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:51.082988 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:51.082996 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:51.083523 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:51.084083 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:51.084100 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.085207 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.085211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:51.086769 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:51.086784 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.087669 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.087676 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:51.087906 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:51.088537 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:51.088561 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:51.091045 (+ 2484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:51.094034 (+ 2989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:51.094041 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:51.094052 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:51.094501 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:51.094884 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:51.094887 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:51.094890 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:51.095106 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:51.095780 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:51.095786 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:51.096136 (+ 350us) client_negotiation.cc:769] Sending connection context
0811 06:48:51.096359 (+ 223us) client_negotiation.cc:240] Negotiation successful
0811 06:48:51.096749 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":346,"threads_started":1}
I20260811 06:48:51.099150 13699 heartbeater.cc:347] Connected to a master server at 127.12.145.62:34295
I20260811 06:48:51.099472 13699 heartbeater.cc:464] Registering TS with master...
I20260811 06:48:51.100252 13699 heartbeater.cc:511] Master 127.12.145.62:34295 requested a full tablet report, sending...
I20260811 06:48:51.101876 12957 ts_manager.cc:194] Registered new tserver with Master: 772a9daea0b04406b229e7dd91013866 (127.12.145.3:43673)
I20260811 06:48:51.102617 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:48:51.102952 12957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:39565
Aug 11 06:48:51 dist-test-slave-7lbf krb5kdc[12884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430931, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 06:48:51 dist-test-slave-7lbf krb5kdc[12884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430931, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:48:51.154094 13711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:51.138638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46326 (local address 127.12.145.1:38175)
0811 06:48:51.139438 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:51.139445 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:51.139471 (+ 26us) server_negotiation.cc:407] Connection header received
0811 06:48:51.139532 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:51.139539 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:51.139748 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:51.139895 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:51.141386 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.142478 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.143777 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.144344 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.144472 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:51.148470 (+ 3998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:51.148482 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:51.148496 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:51.148530 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:51.151259 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.151890 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.151898 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.151921 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.152046 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.152413 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.152418 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.152420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.152772 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:51.153062 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:51.153366 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 06:48:51.153674 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":422,"threads_started":1}
W20260811 06:48:51.155364 13125 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46326
Aug 11 06:48:51 dist-test-slave-7lbf krb5kdc[12884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 06:48:51 dist-test-slave-7lbf krb5kdc[12884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:48:51.204701 13711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:51.191234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46328 (local address 127.12.145.1:38175)
0811 06:48:51.191471 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:51.191478 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:51.191737 (+ 259us) server_negotiation.cc:407] Connection header received
0811 06:48:51.191879 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:51.191883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:51.191955 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:51.192038 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:51.193260 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.194000 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.195281 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.195688 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.195807 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:51.199684 (+ 3877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:51.199689 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:51.199692 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:51.199724 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:51.202309 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.203031 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.203035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.203037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.203150 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.203486 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.203489 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.203491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.203715 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:51.203924 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:51.204261 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 06:48:51.204434 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:48:51.206779 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 13058
I20260811 06:48:51.219238 13711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:51.207982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46332 (local address 127.12.145.1:38175)
0811 06:48:51.208178 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:51.208184 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:51.208416 (+ 232us) server_negotiation.cc:407] Connection header received
0811 06:48:51.208525 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:51.208528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:51.208583 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:51.208659 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:51.209801 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.210498 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.211835 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.212266 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.212359 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:51.214567 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:51.214571 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:51.214575 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:51.214603 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:51.216965 (+ 2362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.217557 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.217563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.217566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.217706 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.218030 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.218033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.218035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.218265 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:51.218437 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:51.218772 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 06:48:51.218975 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 06:48:51.220072 13252 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:48:51.307075 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 13058
I20260811 06:48:51.329962 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 13267
Aug 11 06:48:51 dist-test-slave-7lbf krb5kdc[12884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:48:51.345916 13723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:51.330889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39256 (local address 127.12.145.2:37383)
0811 06:48:51.331417 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:51.331425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:51.331450 (+ 25us) server_negotiation.cc:407] Connection header received
0811 06:48:51.331526 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:51.331533 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:51.331748 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:51.331873 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:51.332990 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.334045 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.335515 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.336049 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.336146 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:51.340455 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:51.340467 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:51.340492 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:51.340526 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:51.343336 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.343916 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.343922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.343924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.344041 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.344445 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.344448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.344450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.344778 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:51.345013 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:51.345313 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 06:48:51.345549 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":261,"threads_started":1}
I20260811 06:48:51.347206 13464 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:48:51.428203 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 13267
I20260811 06:48:51.449214 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 13482
Aug 11 06:48:51 dist-test-slave-7lbf krb5kdc[12884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:48:51.465260 13726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:51.450500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59086 (local address 127.12.145.3:43673)
0811 06:48:51.451227 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:51.451234 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:51.451267 (+ 33us) server_negotiation.cc:407] Connection header received
0811 06:48:51.451338 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:51.451344 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:51.451555 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:51.451697 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:51.452953 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.454114 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.455346 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:51.455937 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:51.456048 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:51.459859 (+ 3811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:51.459871 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:51.459885 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:51.459921 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:51.462845 (+ 2924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.463400 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.463406 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.463408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.463534 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:51.463848 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:51.463851 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:51.463853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:51.464212 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:51.464451 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:51.464650 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 06:48:51.464862 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":370,"threads_started":1}
I20260811 06:48:51.466630 13691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:48:51.549963 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 13482
I20260811 06:48:51.570739 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 12902
I20260811 06:48:51.571993 13007 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:48:51.674190 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 12902
2026-08-11T06:48:51Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (6064 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:48:51 dist-test-slave-7lbf krb5kdc[13735](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:48:51 dist-test-slave-7lbf krb5kdc[13735](info): set up 2 sockets
Aug 11 06:48:51 dist-test-slave-7lbf krb5kdc[13735](info): commencing operation
krb5kdc: starting...
W20260811 06:48:52.886548 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.003s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:48:53 dist-test-slave-7lbf krb5kdc[13735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:48:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:48:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:48:53.070839 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:33379
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:33379
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:53.390986 13765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:53.391299 13765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:53.391436 13765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:53.398504 13765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:48:53.398613 13765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:53.398690 13765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:53.398766 13765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:48:53.398828 13765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:48:53.408383 13765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:33379
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:33379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:53.409672 13765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:53.411012 13765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:53.422369 13775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:53.422401 13777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:53.422439 13779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:53.423794 13765 server_base.cc:1034] running on GCE node
I20260811 06:48:53.424532 13765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:53.425900 13765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:53.427101 13765 hybrid_clock.cc:648] HybridClock initialized: now 1786430933427052 us; error 37 us; skew 500 ppm
I20260811 06:48:53.427480 13765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:53 dist-test-slave-7lbf krb5kdc[13735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430933, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:53.430485 13765 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:48:53.431936 13765 webserver.cc:460] Webserver started at http://127.12.145.62:39485/ using document root <none> and password file <none>
I20260811 06:48:53.432598 13765 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:53.432715 13765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:53.433013 13765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:53.435926 13765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "b0beb6175314400890e09b452e5b677f"
format_stamp: "Formatted at 2026-08-11 06:48:53 on dist-test-slave-7lbf"
server_key: "440466f9282c4d56b274e0ca2f31aadc"
server_key_iv: "1204b683f927b8059b3b35cb96116a27"
server_key_version: "encryptionkey@0"
I20260811 06:48:53.436661 13765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "b0beb6175314400890e09b452e5b677f"
format_stamp: "Formatted at 2026-08-11 06:48:53 on dist-test-slave-7lbf"
server_key: "440466f9282c4d56b274e0ca2f31aadc"
server_key_iv: "1204b683f927b8059b3b35cb96116a27"
server_key_version: "encryptionkey@0"
I20260811 06:48:53.441712 13765 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:48:53.444953 13790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:53.446262 13765 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:48:53.446396 13765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "b0beb6175314400890e09b452e5b677f"
format_stamp: "Formatted at 2026-08-11 06:48:53 on dist-test-slave-7lbf"
server_key: "440466f9282c4d56b274e0ca2f31aadc"
server_key_iv: "1204b683f927b8059b3b35cb96116a27"
server_key_version: "encryptionkey@0"
I20260811 06:48:53.446570 13765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:53.464560 13765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:53.469158 13765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:53.469406 13765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:53.485841 13765 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:33379
I20260811 06:48:53.485853 13869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:33379 every 8 connection(s)
I20260811 06:48:53.487210 13765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:48:53.490895 13870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:53.496377 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 13765
I20260811 06:48:53.496565 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:48:53.497210 12868 external_mini_cluster.cc:1428] Setting key 6e2e4cd30206677c985ecae0051b80f6
I20260811 06:48:53.501492 13870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f: Bootstrap starting.
I20260811 06:48:53.505029 13870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:53.506181 13870 log.cc:824] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f: Log is configured to *not* fsync() on all Append() calls
I20260811 06:48:53.509183 13870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f: No bootstrap required, opened a new log
Aug 11 06:48:53 dist-test-slave-7lbf krb5kdc[13735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:53.519291 13870 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0beb6175314400890e09b452e5b677f" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33379 } }
I20260811 06:48:53.519762 13870 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:53.519887 13870 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0beb6175314400890e09b452e5b677f, State: Initialized, Role: FOLLOWER
I20260811 06:48:53.520581 13870 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0beb6175314400890e09b452e5b677f" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33379 } }
I20260811 06:48:53.520884 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:53.499137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56178 (local address 127.12.145.62:33379)
0811 06:48:53.499920 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:53.499932 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:53.499972 (+ 40us) server_negotiation.cc:407] Connection header received
0811 06:48:53.501742 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:53.501765 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:53.502121 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:53.502425 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:53.504267 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:53.505624 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:53.507241 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:53.507935 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:53.508065 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:53.512529 (+ 4464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:53.512541 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:53.512559 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:53.512612 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:53.516496 (+ 3884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:53.517110 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:53.517119 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:53.517128 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:53.517345 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:53.517713 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:53.517718 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:53.517721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:53.518426 (+ 705us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:53.518688 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:53.519082 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 06:48:53.519500 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":377,"threads_started":1}
I20260811 06:48:53.520881 13870 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:48:53.521098 13870 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:48:53.521308 13870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:53.524281 13870 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0beb6175314400890e09b452e5b677f" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33379 } }
I20260811 06:48:53.524761 13870 leader_election.cc:302] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0beb6175314400890e09b452e5b677f; no voters:
I20260811 06:48:53.525350 13870 leader_election.cc:288] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:48:53.525451 13886 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:48:53.526084 13886 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [term 1 LEADER]: Becoming Leader. State: Replica: b0beb6175314400890e09b452e5b677f, State: Running, Role: LEADER
I20260811 06:48:53.526613 13886 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0beb6175314400890e09b452e5b677f" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33379 } }
I20260811 06:48:53.527307 13870 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:48:53.529142 13887 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0beb6175314400890e09b452e5b677f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0beb6175314400890e09b452e5b677f" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33379 } } }
I20260811 06:48:53.529556 13887 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [sys.catalog]: This master's current role is: LEADER
I20260811 06:48:53.531670 13889 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0beb6175314400890e09b452e5b677f. Latest consensus state: current_term: 1 leader_uuid: "b0beb6175314400890e09b452e5b677f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0beb6175314400890e09b452e5b677f" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33379 } } }
I20260811 06:48:53.531826 13897 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:48:53.531908 13889 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f [sys.catalog]: This master's current role is: LEADER
I20260811 06:48:53.537468 13897 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:48:53.546327 13897 catalog_manager.cc:1347] Generated new cluster ID: 76ab7bcd31e249b0b50b6be6dbe71546
I20260811 06:48:53.546769 13897 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:48:53.593214 13897 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:48:53.595202 13897 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:48:53.609114 13897 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0beb6175314400890e09b452e5b677f: Generated new TSK 0
I20260811 06:48:53.610076 13897 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:48:53.668483 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33379
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:53.993283 13921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:53.993626 13921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:53.993754 13921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:54.001118 13921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:54.001245 13921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:54.001369 13921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:48:54.011655 13921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33379
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:54.012982 13921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:54.014456 13921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:54.027558 13928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:54.027550 13930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:54.028105 13932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:54.028704 13921 server_base.cc:1034] running on GCE node
I20260811 06:48:54.029260 13921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:54.030299 13921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:54.031502 13921 hybrid_clock.cc:648] HybridClock initialized: now 1786430934031442 us; error 48 us; skew 500 ppm
I20260811 06:48:54.031994 13921 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:54 dist-test-slave-7lbf krb5kdc[13735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430934, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:54.035243 13921 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:48:54.036780 13921 webserver.cc:460] Webserver started at http://127.12.145.1:46251/ using document root <none> and password file <none>
I20260811 06:48:54.037436 13921 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:54.037601 13921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:54.037915 13921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:54.040829 13921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "def0044a8f744a2abfc03c2f99d070ad"
format_stamp: "Formatted at 2026-08-11 06:48:54 on dist-test-slave-7lbf"
server_key: "0ba39ece4c4656fa7ab7d029a075efef"
server_key_iv: "2c205929b3e43fa5bd5fd3fc91fe1d00"
server_key_version: "encryptionkey@0"
I20260811 06:48:54.041635 13921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "def0044a8f744a2abfc03c2f99d070ad"
format_stamp: "Formatted at 2026-08-11 06:48:54 on dist-test-slave-7lbf"
server_key: "0ba39ece4c4656fa7ab7d029a075efef"
server_key_iv: "2c205929b3e43fa5bd5fd3fc91fe1d00"
server_key_version: "encryptionkey@0"
I20260811 06:48:54.046715 13921 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 06:48:54.050226 13948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:54.051622 13921 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:48:54.051771 13921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "def0044a8f744a2abfc03c2f99d070ad"
format_stamp: "Formatted at 2026-08-11 06:48:54 on dist-test-slave-7lbf"
server_key: "0ba39ece4c4656fa7ab7d029a075efef"
server_key_iv: "2c205929b3e43fa5bd5fd3fc91fe1d00"
server_key_version: "encryptionkey@0"
I20260811 06:48:54.051949 13921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:54.070652 13921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:54.074851 13921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:54.075127 13921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:54.076161 13921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:48:54.077543 13921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:48:54.077617 13921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:54.077739 13921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:48:54.077790 13921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:54.109582 13921 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:46523
I20260811 06:48:54.109619 14136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:46523 every 8 connection(s)
I20260811 06:48:54.110884 13921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:48:54.116907 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 13921
I20260811 06:48:54.117102 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:48:54.117913 12868 external_mini_cluster.cc:1428] Setting key 2189b4e4666c7cd0509dfa038a5fc5c5
Aug 11 06:48:54 dist-test-slave-7lbf krb5kdc[13735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430934, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:54.133603 14145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:54.117709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:40759 (local address 127.12.145.62:33379)
0811 06:48:54.118194 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:54.118200 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:54.118221 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:48:54.118279 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:54.118282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:54.118343 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:54.118442 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:54.119983 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:54.120698 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:54.122952 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:54.123363 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:54.123463 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:54.127196 (+ 3733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:54.127202 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:54.127206 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:54.127244 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:54.130351 (+ 3107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:54.131090 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:54.131095 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:54.131098 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:54.131243 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:54.131656 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:54.131660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:54.131663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:54.132001 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:54.132135 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:54.132943 (+ 808us) server_negotiation.cc:299] Negotiation successful
0811 06:48:54.133194 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":258,"threads_started":1}
I20260811 06:48:54.134675 14142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:54.114255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:33379 (local address 127.12.145.1:40759)
0811 06:48:54.115074 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:54.115121 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:54.117028 (+ 1907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:54.118685 (+ 1657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:54.118693 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:54.119208 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:54.119795 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:54.119820 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:54.120871 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:54.120876 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:54.122808 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:54.122825 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:54.123600 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:54.123606 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:54.123865 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:54.124522 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:54.124556 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:54.126973 (+ 2417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:54.130497 (+ 3524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:54.130504 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:54.130517 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:54.130954 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:54.131346 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:54.131349 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:54.131351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:54.131531 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:54.132169 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:54.132176 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:54.132513 (+ 337us) client_negotiation.cc:769] Sending connection context
0811 06:48:54.132817 (+ 304us) client_negotiation.cc:240] Negotiation successful
0811 06:48:54.133236 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":309,"threads_started":1}
I20260811 06:48:54.136335 14137 heartbeater.cc:347] Connected to a master server at 127.12.145.62:33379
I20260811 06:48:54.136682 14137 heartbeater.cc:464] Registering TS with master...
I20260811 06:48:54.137652 14137 heartbeater.cc:511] Master 127.12.145.62:33379 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
I20260811 06:48:54.140111 13820 ts_manager.cc:194] Registered new tserver with Master: def0044a8f744a2abfc03c2f99d070ad (127.12.145.1:46523)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
I20260811 06:48:54.142064 13820 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:40759
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:48:54.162510 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33379
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:54.481021 14148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:54.481319 14148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:54.481472 14148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:54.488626 14148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:54.488740 14148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:54.488898 14148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:48:54.498335 14148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33379
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:54.499539 14148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:54.500813 14148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:54.514251 14156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:54.514292 14159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:54.514593 14161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:54.515128 14148 server_base.cc:1034] running on GCE node
I20260811 06:48:54.515682 14148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:54.516571 14148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:54.517764 14148 hybrid_clock.cc:648] HybridClock initialized: now 1786430934517702 us; error 56 us; skew 500 ppm
I20260811 06:48:54.518071 14148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:54 dist-test-slave-7lbf krb5kdc[13735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430934, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:54.521075 14148 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:48:54.522614 14148 webserver.cc:460] Webserver started at http://127.12.145.2:43051/ using document root <none> and password file <none>
I20260811 06:48:54.523264 14148 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:54.523381 14148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:54.523682 14148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:54.526588 14148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "a15ecf3db1d546c095f66b46f8b73250"
format_stamp: "Formatted at 2026-08-11 06:48:54 on dist-test-slave-7lbf"
server_key: "63cd93fb16ec08a8d034b41d41cd19aa"
server_key_iv: "fc5020ca86b7b3dd45d6ece2951f8041"
server_key_version: "encryptionkey@0"
I20260811 06:48:54.527352 14148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "a15ecf3db1d546c095f66b46f8b73250"
format_stamp: "Formatted at 2026-08-11 06:48:54 on dist-test-slave-7lbf"
server_key: "63cd93fb16ec08a8d034b41d41cd19aa"
server_key_iv: "fc5020ca86b7b3dd45d6ece2951f8041"
server_key_version: "encryptionkey@0"
I20260811 06:48:54.532459 14148 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 06:48:54.536034 14173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:54.537341 14148 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 06:48:54.537504 14148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "a15ecf3db1d546c095f66b46f8b73250"
format_stamp: "Formatted at 2026-08-11 06:48:54 on dist-test-slave-7lbf"
server_key: "63cd93fb16ec08a8d034b41d41cd19aa"
server_key_iv: "fc5020ca86b7b3dd45d6ece2951f8041"
server_key_version: "encryptionkey@0"
I20260811 06:48:54.537796 14148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:54.554567 14148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:54.558588 14148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:54.558862 14148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:54.559785 14148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:48:54.561089 14148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:48:54.561172 14148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:54.561304 14148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:48:54.561359 14148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:54.592032 14148 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:44351
I20260811 06:48:54.592070 14366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:44351 every 8 connection(s)
I20260811 06:48:54.593287 14148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:48:54.600299 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 14148
I20260811 06:48:54.600455 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:48:54.600876 12868 external_mini_cluster.cc:1428] Setting key 49e7b9d13cc62282fa1e9e376be73380
Aug 11 06:48:54 dist-test-slave-7lbf krb5kdc[13735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430934, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:54.614600 14145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:54.595995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:60275 (local address 127.12.145.62:33379)
0811 06:48:54.596205 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:54.596210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:54.597368 (+ 1158us) server_negotiation.cc:407] Connection header received
0811 06:48:54.599360 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:54.599367 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:54.599458 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:54.599560 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:54.601254 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:54.602297 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:54.604398 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:54.604838 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:54.604951 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:54.608691 (+ 3740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:54.608697 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:54.608700 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:54.608731 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:54.611404 (+ 2673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:54.612091 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:54.612096 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:54.612100 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:54.612228 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:54.612632 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:54.612636 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:54.612638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:54.612899 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:54.613029 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:54.613854 (+ 825us) server_negotiation.cc:299] Negotiation successful
0811 06:48:54.614197 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 06:48:54.615389 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:54.596423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:33379 (local address 127.12.145.2:60275)
0811 06:48:54.597181 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:54.597221 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:54.599065 (+ 1844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:54.599829 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:54.599837 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:54.600409 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:54.601063 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:54.601083 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:54.602471 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:54.602476 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:54.604238 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:54.604254 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:54.605067 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:54.605074 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:54.605333 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:54.606041 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:54.606071 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:54.608470 (+ 2399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:54.611536 (+ 3066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:54.611545 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:54.611562 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:54.611978 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:54.612334 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:54.612339 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:54.612343 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:54.612526 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:54.613026 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:54.613033 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:54.613342 (+ 309us) client_negotiation.cc:769] Sending connection context
0811 06:48:54.613688 (+ 346us) client_negotiation.cc:240] Negotiation successful
0811 06:48:54.614203 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":298,"threads_started":1}
I20260811 06:48:54.616853 14369 heartbeater.cc:347] Connected to a master server at 127.12.145.62:33379
I20260811 06:48:54.617197 14369 heartbeater.cc:464] Registering TS with master...
I20260811 06:48:54.618120 14369 heartbeater.cc:511] Master 127.12.145.62:33379 requested a full tablet report, sending...
I20260811 06:48:54.619654 13820 ts_manager.cc:194] Registered new tserver with Master: a15ecf3db1d546c095f66b46f8b73250 (127.12.145.2:44351)
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
I20260811 06:48:54.620476 13820 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:60275
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:48:54.644045 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33379
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:54.967000 14378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:54.967283 14378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:54.967427 14378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:54.974457 14378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:54.974598 14378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:54.974774 14378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:48:54.984457 14378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33379
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:54.985757 14378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:54.987092 14378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:54.999531 14389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:54.999552 14393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:54.999589 14390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:55.000633 14378 server_base.cc:1034] running on GCE node
I20260811 06:48:55.001262 14378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:55.002255 14378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:55.003444 14378 hybrid_clock.cc:648] HybridClock initialized: now 1786430935003398 us; error 40 us; skew 500 ppm
I20260811 06:48:55.003763 14378 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:55 dist-test-slave-7lbf krb5kdc[13735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:55.006875 14378 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:48:55.008296 14378 webserver.cc:460] Webserver started at http://127.12.145.3:42335/ using document root <none> and password file <none>
I20260811 06:48:55.008965 14378 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:55.009069 14378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:55.009377 14378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:55.012286 14378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "fe4d2b324e644b1ebe2e9825125bf64b"
format_stamp: "Formatted at 2026-08-11 06:48:55 on dist-test-slave-7lbf"
server_key: "c3784eeff9bd460a9f81e122ebd9adcf"
server_key_iv: "3e78e83cd36486301d25ac7c560aff4c"
server_key_version: "encryptionkey@0"
I20260811 06:48:55.013142 14378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "fe4d2b324e644b1ebe2e9825125bf64b"
format_stamp: "Formatted at 2026-08-11 06:48:55 on dist-test-slave-7lbf"
server_key: "c3784eeff9bd460a9f81e122ebd9adcf"
server_key_iv: "3e78e83cd36486301d25ac7c560aff4c"
server_key_version: "encryptionkey@0"
I20260811 06:48:55.018429 14378 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 06:48:55.021899 14408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:55.023159 14378 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:48:55.023303 14378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "fe4d2b324e644b1ebe2e9825125bf64b"
format_stamp: "Formatted at 2026-08-11 06:48:55 on dist-test-slave-7lbf"
server_key: "c3784eeff9bd460a9f81e122ebd9adcf"
server_key_iv: "3e78e83cd36486301d25ac7c560aff4c"
server_key_version: "encryptionkey@0"
I20260811 06:48:55.023474 14378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:55.041432 14378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:55.045363 14378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:55.045658 14378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:55.046617 14378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:48:55.047920 14378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:48:55.047997 14378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:55.048120 14378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:48:55.048174 14378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:55.078960 14378 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:41275
I20260811 06:48:55.079002 14597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:41275 every 8 connection(s)
I20260811 06:48:55.080303 14378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:48:55.081559 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 14378
I20260811 06:48:55.081740 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:48:55.082300 12868 external_mini_cluster.cc:1428] Setting key e95264c5d3976c20b5abcb08c1f387e5
Aug 11 06:48:55 dist-test-slave-7lbf krb5kdc[13735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430935, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:55.100235 14145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.083250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:33675 (local address 127.12.145.62:33379)
0811 06:48:55.083435 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.083441 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.084804 (+ 1363us) server_negotiation.cc:407] Connection header received
0811 06:48:55.086810 (+ 2006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.086814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.086891 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.086970 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:55.088443 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.089196 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.090785 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.091193 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.091284 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.094569 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:55.094575 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:55.094579 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:55.094611 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:55.097763 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.098441 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.098445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.098448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.098579 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.098923 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.098926 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.098928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.099171 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:55.099272 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.099851 (+ 579us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.100001 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 06:48:55.101207 14602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.083811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:33379 (local address 127.12.145.3:33675)
0811 06:48:55.084615 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:55.084688 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:55.086559 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:55.087170 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:55.087178 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:55.087726 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:55.088293 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.088310 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.089325 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.089328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.090677 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.090691 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.091359 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.091364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.091567 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.092195 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:55.092222 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:55.094355 (+ 2133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:55.097880 (+ 3525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:55.097886 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:55.097898 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:55.098345 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:55.098658 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:55.098661 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:55.098663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:55.098842 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:55.099257 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:55.099262 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:55.099557 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 06:48:55.099771 (+ 214us) client_negotiation.cc:240] Negotiation successful
0811 06:48:55.100136 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":303,"threads_started":1}
I20260811 06:48:55.102458 14599 heartbeater.cc:347] Connected to a master server at 127.12.145.62:33379
I20260811 06:48:55.102720 14599 heartbeater.cc:464] Registering TS with master...
I20260811 06:48:55.103399 14599 heartbeater.cc:511] Master 127.12.145.62:33379 requested a full tablet report, sending...
I20260811 06:48:55.104694 13820 ts_manager.cc:194] Registered new tserver with Master: fe4d2b324e644b1ebe2e9825125bf64b (127.12.145.3:41275)
I20260811 06:48:55.105464 13820 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:33675
I20260811 06:48:55.109876 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:48:55.130704 14145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.118186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56192 (local address 127.12.145.62:33379)
0811 06:48:55.118337 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.118342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.118808 (+ 466us) server_negotiation.cc:407] Connection header received
0811 06:48:55.118966 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.118970 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.119043 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.119122 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:55.120678 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.121466 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.122710 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.123134 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.123240 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.125499 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:55.125505 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:55.125508 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:55.125573 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:55.128139 (+ 2566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.128747 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.128753 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.128757 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.128889 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.129236 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.129241 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.129244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.129621 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:55.129860 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.130178 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.130383 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 06:48:55.145117 14137 heartbeater.cc:503] Master 127.12.145.62:33379 was elected leader, sending a full tablet report...
I20260811 06:48:55.139683 13820 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:48:55.149005 13820 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:48:55.187029 14631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.165934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48140 (local address 127.12.145.3:41275)
0811 06:48:55.178017 (+ 12083us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.178028 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.178067 (+ 39us) server_negotiation.cc:407] Connection header received
0811 06:48:55.178184 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.178194 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.178468 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.178682 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:55.180252 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.181936 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.184419 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.185854 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.185990 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.186253 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.186535 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.186698 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11896,"thread_start_us":11746,"threads_started":1}
I20260811 06:48:55.187252 14633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.165375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:41275 (local address 127.0.0.1:48140)
0811 06:48:55.177200 (+ 11825us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:55.177220 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:55.177349 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:55.179423 (+ 2074us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:55.179433 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:55.179468 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:55.179898 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.179911 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.182069 (+ 2158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.182074 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.184254 (+ 2180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.184266 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.186081 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.186088 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.186272 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.186321 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 06:48:55.186461 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 06:48:55.186641 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11671,"thread_start_us":760,"threads_started":1}
I20260811 06:48:55.189626 14629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.165463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59278 (local address 127.12.145.2:44351)
0811 06:48:55.181446 (+ 15983us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.181455 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.181497 (+ 42us) server_negotiation.cc:407] Connection header received
0811 06:48:55.181624 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.181632 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.181880 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.182717 (+ 837us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:55.182957 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.184547 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.187141 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.188492 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.188620 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.188805 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.189042 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.189204 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15796,"thread_start_us":16103,"threads_started":1}
I20260811 06:48:55.189618 14628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.165351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:44351 (local address 127.0.0.1:59278)
0811 06:48:55.172014 (+ 6663us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:55.172180 (+ 166us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:55.172577 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:55.182085 (+ 9508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:55.182089 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:55.182115 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:55.182608 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.182622 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.184685 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.184690 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.186920 (+ 2230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.186938 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.188691 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.188697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.188864 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.188887 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 06:48:55.188966 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 06:48:55.189092 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5931,"mutex_wait_us":22,"thread_start_us":16003,"threads_started":1}
I20260811 06:48:55.190996 14634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.166452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48556 (local address 127.12.145.1:46523)
0811 06:48:55.181032 (+ 14580us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.181041 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.181744 (+ 703us) server_negotiation.cc:407] Connection header received
0811 06:48:55.182028 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.182036 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.182239 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.182411 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:55.183417 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.184933 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.187278 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.189562 (+ 2284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.189695 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.189918 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.190506 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.190690 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14365,"thread_start_us":14586,"threads_started":1}
I20260811 06:48:55.192621 14489 tablet_service.cc:1467] Processing CreateTablet for tablet 86978cb617814d7c9fd5abc9c3f92a56 (DEFAULT_TABLE table=test-table [id=2ae0c865bdfe4c28b04dca91e7699511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:48:55.193710 14627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.165860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:46523 (local address 127.0.0.1:48556)
0811 06:48:55.181625 (+ 15765us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:55.181643 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:55.181843 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:55.182427 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:55.182435 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:55.182463 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:55.183189 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.183206 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.185061 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.185066 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.187090 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.187104 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.190058 (+ 2954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.190065 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.190300 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.190344 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 06:48:55.190445 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 06:48:55.190587 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15630,"mutex_wait_us":47,"thread_start_us":13072,"threads_started":1}
I20260811 06:48:55.193540 14251 tablet_service.cc:1467] Processing CreateTablet for tablet 86978cb617814d7c9fd5abc9c3f92a56 (DEFAULT_TABLE table=test-table [id=2ae0c865bdfe4c28b04dca91e7699511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:48:55.194617 14489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86978cb617814d7c9fd5abc9c3f92a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:55.194908 14251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86978cb617814d7c9fd5abc9c3f92a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:55.197248 14022 tablet_service.cc:1467] Processing CreateTablet for tablet 86978cb617814d7c9fd5abc9c3f92a56 (DEFAULT_TABLE table=test-table [id=2ae0c865bdfe4c28b04dca91e7699511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:48:55.198585 14022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86978cb617814d7c9fd5abc9c3f92a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:55.209450 14635 tablet_bootstrap.cc:492] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250: Bootstrap starting.
I20260811 06:48:55.212729 14638 tablet_bootstrap.cc:492] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b: Bootstrap starting.
I20260811 06:48:55.213805 14635 tablet_bootstrap.cc:654] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:55.215541 14635 log.cc:824] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250: Log is configured to *not* fsync() on all Append() calls
I20260811 06:48:55.216276 14638 tablet_bootstrap.cc:654] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:55.216444 14636 tablet_bootstrap.cc:492] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad: Bootstrap starting.
I20260811 06:48:55.217644 14638 log.cc:824] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b: Log is configured to *not* fsync() on all Append() calls
I20260811 06:48:55.219400 14635 tablet_bootstrap.cc:492] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250: No bootstrap required, opened a new log
I20260811 06:48:55.219698 14635 ts_tablet_manager.cc:1397] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260811 06:48:55.220108 14636 tablet_bootstrap.cc:654] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:55.220238 14638 tablet_bootstrap.cc:492] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b: No bootstrap required, opened a new log
I20260811 06:48:55.220491 14638 ts_tablet_manager.cc:1397] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 06:48:55.221352 14636 log.cc:824] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad: Log is configured to *not* fsync() on all Append() calls
I20260811 06:48:55.225191 14636 tablet_bootstrap.cc:492] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad: No bootstrap required, opened a new log
I20260811 06:48:55.225620 14636 ts_tablet_manager.cc:1397] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 06:48:55.229070 14638 raft_consensus.cc:348] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a15ecf3db1d546c095f66b46f8b73250" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 44351 } } peers { permanent_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41275 } } peers { permanent_uuid: "def0044a8f744a2abfc03c2f99d070ad" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 46523 } }
I20260811 06:48:55.229460 14638 raft_consensus.cc:374] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:55.229629 14638 raft_consensus.cc:729] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe4d2b324e644b1ebe2e9825125bf64b, State: Initialized, Role: FOLLOWER
I20260811 06:48:55.230281 14638 consensus_queue.cc:260] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a15ecf3db1d546c095f66b46f8b73250" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 44351 } } peers { permanent_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41275 } } peers { permanent_uuid: "def0044a8f744a2abfc03c2f99d070ad" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 46523 } }
I20260811 06:48:55.230656 14635 raft_consensus.cc:348] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a15ecf3db1d546c095f66b46f8b73250" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 44351 } } peers { permanent_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41275 } } peers { permanent_uuid: "def0044a8f744a2abfc03c2f99d070ad" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 46523 } }
I20260811 06:48:55.231184 14635 raft_consensus.cc:374] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:55.231323 14635 raft_consensus.cc:729] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a15ecf3db1d546c095f66b46f8b73250, State: Initialized, Role: FOLLOWER
I20260811 06:48:55.231681 14599 heartbeater.cc:503] Master 127.12.145.62:33379 was elected leader, sending a full tablet report...
I20260811 06:48:55.232064 14635 consensus_queue.cc:260] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a15ecf3db1d546c095f66b46f8b73250" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 44351 } } peers { permanent_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41275 } } peers { permanent_uuid: "def0044a8f744a2abfc03c2f99d070ad" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 46523 } }
I20260811 06:48:55.232246 14638 ts_tablet_manager.cc:1428] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260811 06:48:55.233371 14369 heartbeater.cc:503] Master 127.12.145.62:33379 was elected leader, sending a full tablet report...
I20260811 06:48:55.235322 14635 ts_tablet_manager.cc:1428] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260811 06:48:55.236671 14636 raft_consensus.cc:348] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a15ecf3db1d546c095f66b46f8b73250" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 44351 } } peers { permanent_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41275 } } peers { permanent_uuid: "def0044a8f744a2abfc03c2f99d070ad" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 46523 } }
I20260811 06:48:55.237104 14636 raft_consensus.cc:374] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:55.237272 14636 raft_consensus.cc:729] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def0044a8f744a2abfc03c2f99d070ad, State: Initialized, Role: FOLLOWER
I20260811 06:48:55.237953 14636 consensus_queue.cc:260] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a15ecf3db1d546c095f66b46f8b73250" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 44351 } } peers { permanent_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41275 } } peers { permanent_uuid: "def0044a8f744a2abfc03c2f99d070ad" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 46523 } }
I20260811 06:48:55.240203 14636 ts_tablet_manager.cc:1428] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260811 06:48:55.324572 14653 raft_consensus.cc:482] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:48:55.324935 14653 raft_consensus.cc:504] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a15ecf3db1d546c095f66b46f8b73250" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 44351 } } peers { permanent_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41275 } } peers { permanent_uuid: "def0044a8f744a2abfc03c2f99d070ad" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 46523 } }
I20260811 06:48:55.327387 14653 leader_election.cc:288] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a15ecf3db1d546c095f66b46f8b73250 (127.12.145.2:44351), fe4d2b324e644b1ebe2e9825125bf64b (127.12.145.3:41275)
W20260811 06:48:55.332109 14601 tablet.cc:2369] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:48:55.335448 14629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.327780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:57843 (local address 127.12.145.2:44351)
0811 06:48:55.328015 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.328021 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.328812 (+ 791us) server_negotiation.cc:407] Connection header received
0811 06:48:55.329022 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.329025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.329091 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.329178 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:55.330268 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.331374 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.333442 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.334496 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.334627 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.334682 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.335036 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.335159 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 06:48:55.335595 14655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.327829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:44351 (local address 127.12.145.1:57843)
0811 06:48:55.328700 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:55.328718 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:55.328887 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:55.329211 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:55.329215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:55.329251 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:55.330135 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.330149 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.331497 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.331501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.333291 (+ 1790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.333308 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.334699 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.334706 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.334880 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.334914 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 06:48:55.335022 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 06:48:55.335158 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":75,"thread_start_us":487,"threads_started":1}
I20260811 06:48:55.335976 14631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.328037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:42011 (local address 127.12.145.3:41275)
0811 06:48:55.328268 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.328274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.328959 (+ 685us) server_negotiation.cc:407] Connection header received
0811 06:48:55.329161 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.329167 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.329240 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.329325 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:55.330226 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.331374 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.333967 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.334976 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.335127 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.335191 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.335614 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.335741 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 06:48:55.336591 14656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.327871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:41275 (local address 127.12.145.1:42011)
0811 06:48:55.328810 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:55.328861 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:55.328995 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:55.329371 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:55.329375 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:55.329403 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:55.330038 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.330048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.331565 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.331569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.333790 (+ 2221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:55.333805 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.335184 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.335190 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:55.335358 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.335388 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 06:48:55.336134 (+ 746us) client_negotiation.cc:240] Negotiation successful
0811 06:48:55.336259 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"mutex_wait_us":4,"thread_start_us":623,"threads_started":1}
I20260811 06:48:55.336853 14284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86978cb617814d7c9fd5abc9c3f92a56" candidate_uuid: "def0044a8f744a2abfc03c2f99d070ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a15ecf3db1d546c095f66b46f8b73250" is_pre_election: true
I20260811 06:48:55.337697 14284 raft_consensus.cc:2454] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate def0044a8f744a2abfc03c2f99d070ad in term 0.
I20260811 06:48:55.337592 14519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86978cb617814d7c9fd5abc9c3f92a56" candidate_uuid: "def0044a8f744a2abfc03c2f99d070ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" is_pre_election: true
I20260811 06:48:55.338145 14519 raft_consensus.cc:2454] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate def0044a8f744a2abfc03c2f99d070ad in term 0.
I20260811 06:48:55.338578 13951 leader_election.cc:302] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a15ecf3db1d546c095f66b46f8b73250, def0044a8f744a2abfc03c2f99d070ad; no voters:
I20260811 06:48:55.339040 14653 raft_consensus.cc:2781] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:48:55.339200 14653 raft_consensus.cc:482] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:48:55.339329 14653 raft_consensus.cc:3037] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:55.342147 14653 raft_consensus.cc:504] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a15ecf3db1d546c095f66b46f8b73250" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 44351 } } peers { permanent_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41275 } } peers { permanent_uuid: "def0044a8f744a2abfc03c2f99d070ad" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 46523 } }
I20260811 06:48:55.342816 14653 leader_election.cc:288] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [CANDIDATE]: Term 1 election: Requested vote from peers a15ecf3db1d546c095f66b46f8b73250 (127.12.145.2:44351), fe4d2b324e644b1ebe2e9825125bf64b (127.12.145.3:41275)
I20260811 06:48:55.343230 14519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86978cb617814d7c9fd5abc9c3f92a56" candidate_uuid: "def0044a8f744a2abfc03c2f99d070ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe4d2b324e644b1ebe2e9825125bf64b"
I20260811 06:48:55.343271 14284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86978cb617814d7c9fd5abc9c3f92a56" candidate_uuid: "def0044a8f744a2abfc03c2f99d070ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a15ecf3db1d546c095f66b46f8b73250"
I20260811 06:48:55.343411 14519 raft_consensus.cc:3037] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:55.343500 14284 raft_consensus.cc:3037] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:48:55.345283 14370 tablet.cc:2369] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:48:55.345957 14519 raft_consensus.cc:2454] T 86978cb617814d7c9fd5abc9c3f92a56 P fe4d2b324e644b1ebe2e9825125bf64b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate def0044a8f744a2abfc03c2f99d070ad in term 1.
I20260811 06:48:55.346083 14284 raft_consensus.cc:2454] T 86978cb617814d7c9fd5abc9c3f92a56 P a15ecf3db1d546c095f66b46f8b73250 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate def0044a8f744a2abfc03c2f99d070ad in term 1.
I20260811 06:48:55.346335 13949 leader_election.cc:302] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: def0044a8f744a2abfc03c2f99d070ad, fe4d2b324e644b1ebe2e9825125bf64b; no voters:
I20260811 06:48:55.346606 14653 raft_consensus.cc:2781] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:48:55.347039 14653 raft_consensus.cc:686] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [term 1 LEADER]: Becoming Leader. State: Replica: def0044a8f744a2abfc03c2f99d070ad, State: Running, Role: LEADER
I20260811 06:48:55.347553 14653 consensus_queue.cc:237] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a15ecf3db1d546c095f66b46f8b73250" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 44351 } } peers { permanent_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41275 } } peers { permanent_uuid: "def0044a8f744a2abfc03c2f99d070ad" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 46523 } }
I20260811 06:48:55.352751 13820 catalog_manager.cc:5495] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad reported cstate change: term changed from 0 to 1, leader changed from <none> to def0044a8f744a2abfc03c2f99d070ad (127.12.145.1). New cstate: current_term: 1 leader_uuid: "def0044a8f744a2abfc03c2f99d070ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a15ecf3db1d546c095f66b46f8b73250" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe4d2b324e644b1ebe2e9825125bf64b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "def0044a8f744a2abfc03c2f99d070ad" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 46523 } health_report { overall_health: HEALTHY } } }
W20260811 06:48:55.363931 14141 tablet.cc:2369] T 86978cb617814d7c9fd5abc9c3f92a56 P def0044a8f744a2abfc03c2f99d070ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 06:48:55 dist-test-slave-7lbf krb5kdc[13735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:48:55.384420 14634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.369433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48570 (local address 127.12.145.1:46523)
0811 06:48:55.369734 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.369741 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.370328 (+ 587us) server_negotiation.cc:407] Connection header received
0811 06:48:55.370479 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.370482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.370580 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.370661 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:55.372085 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.372796 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.374282 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.374672 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.374760 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.378931 (+ 4171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:55.378947 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:55.378963 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:55.379003 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:55.381871 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.382546 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.382553 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.382556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.382724 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.383046 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.383049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.383051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.383383 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:55.383615 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.383920 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.384105 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 06:48:55 dist-test-slave-7lbf krb5kdc[13735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430935, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 06:48:55 dist-test-slave-7lbf krb5kdc[13735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430935, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:48:55.434557 14634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.420348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48578 (local address 127.12.145.1:46523)
0811 06:48:55.420566 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.420573 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.420999 (+ 426us) server_negotiation.cc:407] Connection header received
0811 06:48:55.421181 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.421185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.421254 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.421347 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:55.422706 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.423435 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.424822 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.425250 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.425367 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.429607 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:55.429613 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:55.429617 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:55.429656 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:55.432130 (+ 2474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.432711 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.432716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.432718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.432872 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.433218 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.433222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.433224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.433547 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:55.433829 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.433964 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.434153 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 06:48:55 dist-test-slave-7lbf krb5kdc[13735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 06:48:55 dist-test-slave-7lbf krb5kdc[13735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:48:55.482152 14634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.468244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48584 (local address 127.12.145.1:46523)
0811 06:48:55.468425 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.468432 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.468763 (+ 331us) server_negotiation.cc:407] Connection header received
0811 06:48:55.468947 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.468951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.469036 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.469122 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:55.470563 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.471304 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.472552 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.473042 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.473163 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.477235 (+ 4072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:55.477240 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:55.477243 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:55.477278 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:55.479666 (+ 2388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.480285 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.480290 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.480292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.480430 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.480766 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.480770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.480772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.481047 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:55.481287 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.481612 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.481843 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 06:48:55.484362 13984 tablet_service.cc:2908] Rejecting scan request for tablet 86978cb617814d7c9fd5abc9c3f92a56: Uninitialized: clean time has not yet been initialized
I20260811 06:48:55.488256 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 13921
I20260811 06:48:55.501739 14634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.489154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48598 (local address 127.12.145.1:46523)
0811 06:48:55.489350 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.489356 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.489673 (+ 317us) server_negotiation.cc:407] Connection header received
0811 06:48:55.489833 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.489836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.489894 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.489966 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:55.491369 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.492078 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.493799 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.494188 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.494273 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.496823 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:55.496828 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:55.496831 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:55.496860 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:55.499296 (+ 2436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.500011 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.500014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.500017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.500129 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.500553 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.500556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.500558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.500782 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:55.500955 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.501222 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.501411 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 06:48:55.502329 14124 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:48:55.592202 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 13921
I20260811 06:48:55.617815 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 14148
Aug 11 06:48:55 dist-test-slave-7lbf krb5kdc[13735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:48:55.632341 14629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.618689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59290 (local address 127.12.145.2:44351)
0811 06:48:55.618846 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.618851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.618867 (+ 16us) server_negotiation.cc:407] Connection header received
0811 06:48:55.618921 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.618925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.618994 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.619082 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:55.620203 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.620980 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.622462 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.622860 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.622953 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.626824 (+ 3871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:55.626836 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:55.626853 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:55.626887 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:55.629910 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.630520 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.630526 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.630529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.630660 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.630945 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.630949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.630952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.631395 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:55.631656 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.631835 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.632013 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 06:48:55.633013 14358 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:48:55.720854 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 14148
I20260811 06:48:55.742019 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 14378
Aug 11 06:48:55 dist-test-slave-7lbf krb5kdc[13735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430935, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:48:55.756016 14631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:55.742919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48150 (local address 127.12.145.3:41275)
0811 06:48:55.743106 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:55.743111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:55.743131 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:48:55.743233 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:55.743237 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:55.743301 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:55.743391 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:55.744590 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.745308 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.746601 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:55.746986 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:55.747077 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:55.751070 (+ 3993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:55.751087 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:55.751105 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:55.751138 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:55.753713 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.754348 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.754355 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.754358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.754491 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:55.754774 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:55.754777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:55.754779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:55.755118 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:55.755332 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:55.755572 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 06:48:55.755742 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 06:48:55.756623 14591 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:48:55.842037 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 14378
I20260811 06:48:55.862991 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 13765
I20260811 06:48:55.864146 13862 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:48:55.972457 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 13765
2026-08-11T06:48:55Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4299 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:48:56 dist-test-slave-7lbf krb5kdc[14688](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:48:56 dist-test-slave-7lbf krb5kdc[14688](info): set up 2 sockets
Aug 11 06:48:56 dist-test-slave-7lbf krb5kdc[14688](info): commencing operation
krb5kdc: starting...
W20260811 06:48:57.209708 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:48:57 dist-test-slave-7lbf krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:48:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:48:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:48:57.403445 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:44355
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:44355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:57.726969 14709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:57.727283 14709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:57.727422 14709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:57.734645 14709 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:48:57.734776 14709 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 06:48:57.734853 14709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:57.734935 14709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:57.735002 14709 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:48:57.735088 14709 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:48:57.744975 14709 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:44355
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:44355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:57.746572 14709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:57.748003 14709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:57.760069 14720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:57.760133 14724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:57.760133 14719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:57.761395 14709 server_base.cc:1034] running on GCE node
I20260811 06:48:57.762251 14709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:57.763671 14709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:57.764878 14709 hybrid_clock.cc:648] HybridClock initialized: now 1786430937764813 us; error 37 us; skew 500 ppm
I20260811 06:48:57.765233 14709 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:57 dist-test-slave-7lbf krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430937, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:57.768440 14709 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:48:57.770098 14709 webserver.cc:460] Webserver started at http://127.12.145.62:43393/ using document root <none> and password file <none>
I20260811 06:48:57.770833 14709 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:57.770926 14709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:57.771216 14709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:57.774327 14709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "8b40ddbcda804b0dbd8574436cdbde88"
format_stamp: "Formatted at 2026-08-11 06:48:57 on dist-test-slave-7lbf"
server_key: "9ec7e9bdbe1dac3b7773e00380058bdf"
server_key_iv: "83b92f37ed6c4eb87e38cc4dcb1968ea"
server_key_version: "encryptionkey@0"
I20260811 06:48:57.775103 14709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "8b40ddbcda804b0dbd8574436cdbde88"
format_stamp: "Formatted at 2026-08-11 06:48:57 on dist-test-slave-7lbf"
server_key: "9ec7e9bdbe1dac3b7773e00380058bdf"
server_key_iv: "83b92f37ed6c4eb87e38cc4dcb1968ea"
server_key_version: "encryptionkey@0"
I20260811 06:48:57.780679 14709 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 06:48:57.784245 14734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:57.785710 14709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:48:57.785889 14709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "8b40ddbcda804b0dbd8574436cdbde88"
format_stamp: "Formatted at 2026-08-11 06:48:57 on dist-test-slave-7lbf"
server_key: "9ec7e9bdbe1dac3b7773e00380058bdf"
server_key_iv: "83b92f37ed6c4eb87e38cc4dcb1968ea"
server_key_version: "encryptionkey@0"
I20260811 06:48:57.786114 14709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:57.800673 14709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:57.804904 14709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:57.805181 14709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:57.826706 14709 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:44355
I20260811 06:48:57.826726 14829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:44355 every 8 connection(s)
I20260811 06:48:57.828107 14709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:48:57.832036 14830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:57.833277 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 14709
I20260811 06:48:57.833508 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:48:57.834384 12868 external_mini_cluster.cc:1428] Setting key b4edc397943786115d59ca29aa2fa1f5
I20260811 06:48:57.846383 14830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88: Bootstrap starting.
Aug 11 06:48:57 dist-test-slave-7lbf krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:57.850359 14830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:57.851540 14830 log.cc:824] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88: Log is configured to *not* fsync() on all Append() calls
I20260811 06:48:57.854861 14830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88: No bootstrap required, opened a new log
I20260811 06:48:57.857373 14834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:57.836424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40842 (local address 127.12.145.62:44355)
0811 06:48:57.837240 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:57.837251 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:57.837294 (+ 43us) server_negotiation.cc:407] Connection header received
0811 06:48:57.838953 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:57.838984 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:57.839383 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:57.839722 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:57.841352 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:57.842705 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:57.844423 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:57.845079 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:57.845205 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:57.849988 (+ 4783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:57.849997 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:57.850011 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:57.850053 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:57.853348 (+ 3295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:57.854152 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:57.854159 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:57.854165 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:57.854343 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:57.854730 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:57.854733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:57.854735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:57.855299 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:57.855525 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:57.855950 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 06:48:57.856300 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":363,"threads_started":1}
I20260811 06:48:57.862557 14830 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b40ddbcda804b0dbd8574436cdbde88" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 44355 } }
I20260811 06:48:57.862900 14830 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:57.863008 14830 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b40ddbcda804b0dbd8574436cdbde88, State: Initialized, Role: FOLLOWER
I20260811 06:48:57.863541 14830 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b40ddbcda804b0dbd8574436cdbde88" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 44355 } }
I20260811 06:48:57.863749 14830 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:48:57.863897 14830 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:48:57.864058 14830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:57.866222 14830 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b40ddbcda804b0dbd8574436cdbde88" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 44355 } }
I20260811 06:48:57.866693 14830 leader_election.cc:302] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b40ddbcda804b0dbd8574436cdbde88; no voters:
I20260811 06:48:57.867298 14830 leader_election.cc:288] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:48:57.867409 14838 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:48:57.868139 14838 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [term 1 LEADER]: Becoming Leader. State: Replica: 8b40ddbcda804b0dbd8574436cdbde88, State: Running, Role: LEADER
I20260811 06:48:57.868736 14838 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b40ddbcda804b0dbd8574436cdbde88" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 44355 } }
I20260811 06:48:57.869490 14830 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:48:57.871815 14843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b40ddbcda804b0dbd8574436cdbde88. Latest consensus state: current_term: 1 leader_uuid: "8b40ddbcda804b0dbd8574436cdbde88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b40ddbcda804b0dbd8574436cdbde88" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 44355 } } }
I20260811 06:48:57.872246 14843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [sys.catalog]: This master's current role is: LEADER
I20260811 06:48:57.873792 14839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b40ddbcda804b0dbd8574436cdbde88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b40ddbcda804b0dbd8574436cdbde88" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 44355 } } }
I20260811 06:48:57.874171 14839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88 [sys.catalog]: This master's current role is: LEADER
I20260811 06:48:57.874322 14860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:48:57.878547 14860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:48:57.887805 14860 catalog_manager.cc:1347] Generated new cluster ID: bc49bcc4011f4729a0f636ce3b90ffe6
I20260811 06:48:57.887923 14860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:48:57.898774 14860 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:48:57.900116 14860 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:48:57.906929 14860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88: Generated new TSK 0
I20260811 06:48:57.907819 14860 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:48:57.955191 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:44355
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:58.288022 14884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:58.288336 14884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:58.288486 14884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:58.295899 14884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:58.296030 14884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:58.296157 14884 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 06:48:58.296269 14884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:48:58.306310 14884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.62:44355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:58.307642 14884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:58.309039 14884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:58.322127 14892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:58.322053 14895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:58.322090 14893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:58.323069 14884 server_base.cc:1034] running on GCE node
I20260811 06:48:58.323664 14884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:58.324579 14884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:58.325798 14884 hybrid_clock.cc:648] HybridClock initialized: now 1786430938325718 us; error 50 us; skew 500 ppm
I20260811 06:48:58.326089 14884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:58 dist-test-slave-7lbf krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430938, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:58.329193 14884 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:48:58.330744 14884 webserver.cc:460] Webserver started at http://127.12.145.1:37859/ using document root <none> and password file <none>
I20260811 06:48:58.331462 14884 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:58.331553 14884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:58.331837 14884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:58.334777 14884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "cd1944528ccc428eb244ff5af75d0a74"
format_stamp: "Formatted at 2026-08-11 06:48:58 on dist-test-slave-7lbf"
server_key: "92af3e40dcd0afea46692dfb5fb9a4f0"
server_key_iv: "1470f35adff33eecc704055d11e614e5"
server_key_version: "encryptionkey@0"
I20260811 06:48:58.335553 14884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "cd1944528ccc428eb244ff5af75d0a74"
format_stamp: "Formatted at 2026-08-11 06:48:58 on dist-test-slave-7lbf"
server_key: "92af3e40dcd0afea46692dfb5fb9a4f0"
server_key_iv: "1470f35adff33eecc704055d11e614e5"
server_key_version: "encryptionkey@0"
I20260811 06:48:58.340654 14884 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:48:58.344131 14904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:58.345435 14884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 06:48:58.345642 14884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "cd1944528ccc428eb244ff5af75d0a74"
format_stamp: "Formatted at 2026-08-11 06:48:58 on dist-test-slave-7lbf"
server_key: "92af3e40dcd0afea46692dfb5fb9a4f0"
server_key_iv: "1470f35adff33eecc704055d11e614e5"
server_key_version: "encryptionkey@0"
I20260811 06:48:58.345847 14884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:58.370038 14884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:58.374698 14884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:58.374982 14884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:58.378036 14884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:48:58.378153 14884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:58.378312 14884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:48:58.378384 14884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 06:48:58 dist-test-slave-7lbf krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430938, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:58.402192 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:58.378715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:59589 (local address 127.12.145.62:44355)
0811 06:48:58.379220 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:58.379226 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:58.380578 (+ 1352us) server_negotiation.cc:407] Connection header received
0811 06:48:58.382711 (+ 2133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:58.382717 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:58.382807 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:58.382916 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:58.385256 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.386471 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.388920 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.389659 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.389809 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:58.394625 (+ 4816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:58.394633 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:58.394639 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:58.394690 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:58.398257 (+ 3567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:58.399349 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:58.399358 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:58.399362 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:58.399558 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:58.400179 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:58.400185 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:58.400188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:58.400586 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:58.400724 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:58.401582 (+ 858us) server_negotiation.cc:299] Negotiation successful
0811 06:48:58.401819 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":281,"threads_started":1}
I20260811 06:48:58.403259 14919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:58.379564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:44355 (local address 127.12.145.1:59589)
0811 06:48:58.380404 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:58.380444 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:58.382416 (+ 1972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:58.383203 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:58.383216 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:58.384067 (+ 851us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:58.385000 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:58.385039 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.386644 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.386650 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:58.388767 (+ 2117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:58.388781 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.389986 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.389995 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:58.390271 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:58.391188 (+ 917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:58.391213 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:58.394318 (+ 3105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:58.398454 (+ 4136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:58.398466 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:58.398489 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:58.399162 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:58.399718 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:58.399727 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:58.399730 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:58.400051 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:58.400730 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:58.400739 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:58.401146 (+ 407us) client_negotiation.cc:769] Sending connection context
0811 06:48:58.401444 (+ 298us) client_negotiation.cc:240] Negotiation successful
0811 06:48:58.402031 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":349,"threads_started":1}
I20260811 06:48:58.428556 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:58.409578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:34877 (local address 127.12.145.62:44355)
0811 06:48:58.409783 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:58.409790 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:58.414086 (+ 4296us) server_negotiation.cc:407] Connection header received
0811 06:48:58.414227 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:58.414233 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:58.414338 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:58.414466 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:58.415870 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.417144 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.418650 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.419355 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.419504 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:58.422481 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:58.422488 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:58.422493 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:58.422538 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:58.425671 (+ 3133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:58.426619 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:58.426624 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:58.426627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:58.426773 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:58.427137 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:58.427141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:58.427143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:58.427421 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:58.427553 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:58.427988 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 06:48:58.428205 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 06:48:58.428642 15019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:58.409557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:44355 (local address 127.12.145.1:34877)
0811 06:48:58.413956 (+ 4399us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:58.413979 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:58.414113 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:58.414541 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:58.414546 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:58.415234 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:58.415662 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:58.415679 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.417306 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.417310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:58.418493 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:58.418507 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.419818 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.419832 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:58.420078 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:58.420816 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:58.420847 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:58.422221 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:58.425854 (+ 3633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:58.425860 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:58.425864 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:58.426484 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:58.426883 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:58.426888 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:58.426893 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:58.427024 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:58.427536 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:58.427541 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:58.427725 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 06:48:58.427838 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 06:48:58.428182 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4236,"thread_start_us":4090,"threads_started":1}
I20260811 06:48:58.434420 14884 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:34541
I20260811 06:48:58.434437 15092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:34541 every 8 connection(s)
I20260811 06:48:58.435729 14884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:48:58.437258 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 14884
I20260811 06:48:58.437477 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:48:58.437868 15094 heartbeater.cc:347] Connected to a master server at 127.12.145.62:44355
I20260811 06:48:58.438129 15094 heartbeater.cc:464] Registering TS with master...
I20260811 06:48:58.438326 12868 external_mini_cluster.cc:1428] Setting key b885146af6fa85c06c4307d175938eda
I20260811 06:48:58.438941 15094 heartbeater.cc:511] Master 127.12.145.62:44355 requested a full tablet report, sending...
I20260811 06:48:58.441190 14759 ts_manager.cc:194] Registered new tserver with Master: cd1944528ccc428eb244ff5af75d0a74 (127.12.145.1:34541)
I20260811 06:48:58.442829 14759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:59589
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:48:58.481495 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:44355
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:58.813128 15102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:58.813441 15102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:58.813589 15102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:58.820982 15102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:58.821101 15102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:58.821184 15102 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 06:48:58.821265 15102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:48:58.831452 15102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.62:44355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:58.832772 15102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:58.834223 15102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:58.847536 15113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:58.847570 15110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:58.847620 15109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:58.848263 15102 server_base.cc:1034] running on GCE node
I20260811 06:48:58.848913 15102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:58.849951 15102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:58.851197 15102 hybrid_clock.cc:648] HybridClock initialized: now 1786430938851113 us; error 48 us; skew 500 ppm
I20260811 06:48:58.851513 15102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:58 dist-test-slave-7lbf krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430938, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:58.854805 15102 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:48:58.856336 15102 webserver.cc:460] Webserver started at http://127.12.145.2:39237/ using document root <none> and password file <none>
I20260811 06:48:58.857062 15102 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:58.857170 15102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:58.857506 15102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:58.860617 15102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "99c5a7d2cd8a433682f1e31300002897"
format_stamp: "Formatted at 2026-08-11 06:48:58 on dist-test-slave-7lbf"
server_key: "7bc645347e7b0e7b67284e2d21cf86fd"
server_key_iv: "1c4d63d77c4fb858a0295a0445b4b8ee"
server_key_version: "encryptionkey@0"
I20260811 06:48:58.861433 15102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "99c5a7d2cd8a433682f1e31300002897"
format_stamp: "Formatted at 2026-08-11 06:48:58 on dist-test-slave-7lbf"
server_key: "7bc645347e7b0e7b67284e2d21cf86fd"
server_key_iv: "1c4d63d77c4fb858a0295a0445b4b8ee"
server_key_version: "encryptionkey@0"
I20260811 06:48:58.866781 15102 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 06:48:58.870384 15126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:58.871884 15102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 06:48:58.872080 15102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "99c5a7d2cd8a433682f1e31300002897"
format_stamp: "Formatted at 2026-08-11 06:48:58 on dist-test-slave-7lbf"
server_key: "7bc645347e7b0e7b67284e2d21cf86fd"
server_key_iv: "1c4d63d77c4fb858a0295a0445b4b8ee"
server_key_version: "encryptionkey@0"
I20260811 06:48:58.872313 15102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:58.887157 15102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:58.891455 15102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:58.891714 15102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:58.894523 15102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:48:58.894634 15102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:58.894797 15102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:48:58.894927 15102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 11 06:48:58 dist-test-slave-7lbf krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430938, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:58.917196 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:58.895024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:34767 (local address 127.12.145.62:44355)
0811 06:48:58.895207 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:58.895215 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:58.896643 (+ 1428us) server_negotiation.cc:407] Connection header received
0811 06:48:58.898758 (+ 2115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:58.898764 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:58.898848 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:58.898942 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:58.901023 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.902062 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.904346 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.904922 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.905055 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:58.909982 (+ 4927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:58.909990 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:58.909996 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:58.910045 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:58.913596 (+ 3551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:58.914580 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:58.914587 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:58.914591 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:58.914758 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:58.915326 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:58.915332 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:58.915335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:58.915682 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:58.915827 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:58.916592 (+ 765us) server_negotiation.cc:299] Negotiation successful
0811 06:48:58.916835 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 06:48:58.918789 15145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:58.895661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:44355 (local address 127.12.145.2:34767)
0811 06:48:58.896472 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:58.896518 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:58.898432 (+ 1914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:58.899223 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:58.899236 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:58.899941 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:58.900832 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:58.900858 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.902273 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.902278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:58.904186 (+ 1908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:58.904203 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.905175 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.905183 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:58.905426 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:58.906285 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:58.906322 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:58.909641 (+ 3319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:58.913758 (+ 4117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:58.913769 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:58.913795 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:58.914435 (+ 640us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:58.914901 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:58.914906 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:58.914910 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:58.915159 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:58.915823 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:58.915831 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:58.916197 (+ 366us) client_negotiation.cc:769] Sending connection context
0811 06:48:58.916455 (+ 258us) client_negotiation.cc:240] Negotiation successful
0811 06:48:58.917021 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":366,"threads_started":1}
I20260811 06:48:58.939297 15266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:58.924754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:44355 (local address 127.12.145.2:54003)
0811 06:48:58.925417 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:58.925439 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:58.925609 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:58.925903 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:58.925908 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:58.926515 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:58.926912 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:58.926925 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.927863 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.927869 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:58.929631 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:58.929652 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.930718 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.930723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:58.930861 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:58.931576 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:58.931607 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:58.932638 (+ 1031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:58.935863 (+ 3225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:58.935868 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:58.935873 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:58.936424 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:58.936831 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:58.936840 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:58.936844 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:58.937037 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:58.937918 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:58.937924 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:58.938152 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 06:48:58.938328 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 06:48:58.938807 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":310,"threads_started":1}
I20260811 06:48:58.939330 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:58.924781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:54003 (local address 127.12.145.62:44355)
0811 06:48:58.924975 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:58.924981 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:58.925555 (+ 574us) server_negotiation.cc:407] Connection header received
0811 06:48:58.925718 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:58.925722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:58.925784 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:58.925860 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:58.927037 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.927753 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.929792 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:58.930316 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:58.930448 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:58.932827 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:58.932832 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:58.932835 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:58.932866 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:58.935736 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:58.936542 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:58.936547 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:58.936551 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:58.936703 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:58.937166 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:58.937171 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:58.937175 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:58.937687 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:58.937839 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:58.938806 (+ 967us) server_negotiation.cc:299] Negotiation successful
0811 06:48:58.939038 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:48:58.944096 15102 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:42219
I20260811 06:48:58.944118 15329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:42219 every 8 connection(s)
I20260811 06:48:58.945268 15102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:48:58.947187 15331 heartbeater.cc:347] Connected to a master server at 127.12.145.62:44355
I20260811 06:48:58.947399 15331 heartbeater.cc:464] Registering TS with master...
I20260811 06:48:58.948053 15331 heartbeater.cc:511] Master 127.12.145.62:44355 requested a full tablet report, sending...
I20260811 06:48:58.949424 14759 ts_manager.cc:194] Registered new tserver with Master: 99c5a7d2cd8a433682f1e31300002897 (127.12.145.2:42219)
I20260811 06:48:58.950254 14759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:34767
I20260811 06:48:58.952328 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 15102
I20260811 06:48:58.952517 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:48:58.953019 12868 external_mini_cluster.cc:1428] Setting key 51ec6f1e545124514d0264070be5acd7
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:48:58.996657 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:44355
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:48:59.320060 15336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:48:59.320326 15336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:48:59.320470 15336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:48:59.327502 15336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:48:59.327633 15336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:48:59.327761 15336 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 06:48:59.327885 15336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:48:59.337508 15336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.62:44355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:48:59.338817 15336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:48:59.340159 15336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:48:59.352572 15342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:59.352869 15344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:48:59.353021 15347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:48:59.353760 15336 server_base.cc:1034] running on GCE node
I20260811 06:48:59.354417 15336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:48:59.355342 15336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:48:59.356557 15336 hybrid_clock.cc:648] HybridClock initialized: now 1786430939356497 us; error 34 us; skew 500 ppm
I20260811 06:48:59.356848 15336 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:48:59 dist-test-slave-7lbf krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430939, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:48:59.360014 15336 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:48:59.361426 15336 webserver.cc:460] Webserver started at http://127.12.145.3:37665/ using document root <none> and password file <none>
I20260811 06:48:59.362140 15336 fs_manager.cc:359] Metadata directory not provided
I20260811 06:48:59.362246 15336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:48:59.362564 15336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:48:59.365576 15336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "35d969f27e5c482d8ba74268dcaacbde"
format_stamp: "Formatted at 2026-08-11 06:48:59 on dist-test-slave-7lbf"
server_key: "5f5c4c0405d7710ce8a1b980fd22d571"
server_key_iv: "370208377e24278f6e1d7fccf6ffcfa7"
server_key_version: "encryptionkey@0"
I20260811 06:48:59.366387 15336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "35d969f27e5c482d8ba74268dcaacbde"
format_stamp: "Formatted at 2026-08-11 06:48:59 on dist-test-slave-7lbf"
server_key: "5f5c4c0405d7710ce8a1b980fd22d571"
server_key_iv: "370208377e24278f6e1d7fccf6ffcfa7"
server_key_version: "encryptionkey@0"
I20260811 06:48:59.371856 15336 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:48:59.375660 15360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:59.377221 15336 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:48:59.377405 15336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "35d969f27e5c482d8ba74268dcaacbde"
format_stamp: "Formatted at 2026-08-11 06:48:59 on dist-test-slave-7lbf"
server_key: "5f5c4c0405d7710ce8a1b980fd22d571"
server_key_iv: "370208377e24278f6e1d7fccf6ffcfa7"
server_key_version: "encryptionkey@0"
I20260811 06:48:59.377664 15336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:48:59.400952 15336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:48:59.405011 15336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:48:59.405272 15336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:48:59.408104 15336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:48:59.408192 15336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:48:59.408340 15336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:48:59.408401 15336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 06:48:59 dist-test-slave-7lbf krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430939, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:59.433008 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.408815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:38481 (local address 127.12.145.62:44355)
0811 06:48:59.409010 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.409017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.410488 (+ 1471us) server_negotiation.cc:407] Connection header received
0811 06:48:59.412962 (+ 2474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.412968 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.413065 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.413149 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:59.415705 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.416864 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.419743 (+ 2879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.420313 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.420441 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.425716 (+ 5275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:59.425721 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:59.425725 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:59.425761 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:59.429159 (+ 3398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:59.430228 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:59.430235 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:59.430239 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:59.430417 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:59.431028 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:59.431033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:59.431037 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:59.431349 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:59.431514 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.432432 (+ 918us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.432663 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 06:48:59.434254 15375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.409374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:44355 (local address 127.12.145.3:38481)
0811 06:48:59.410288 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:59.410337 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:59.412586 (+ 2249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:59.413768 (+ 1182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:59.413780 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:59.414587 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:59.415420 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.415448 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.417119 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.417126 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.419550 (+ 2424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.419566 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.420603 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.420610 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.420931 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.421890 (+ 959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:59.421925 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:59.425467 (+ 3542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:59.429337 (+ 3870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:59.429349 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:59.429369 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:59.430071 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:59.430575 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:59.430578 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:59.430581 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:59.430848 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:59.431601 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:59.431610 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:59.432015 (+ 405us) client_negotiation.cc:769] Sending connection context
0811 06:48:59.432264 (+ 249us) client_negotiation.cc:240] Negotiation successful
0811 06:48:59.432791 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":398,"threads_started":1}
I20260811 06:48:59.446133 15094 heartbeater.cc:503] Master 127.12.145.62:44355 was elected leader, sending a full tablet report...
I20260811 06:48:59.453877 15493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.439637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:44355 (local address 127.12.145.3:53317)
0811 06:48:59.440332 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:59.440349 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:59.440480 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:59.440790 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:59.440795 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:59.441274 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:59.441606 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.441617 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.442812 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.442818 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.444333 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.444347 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.445382 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.445386 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.445504 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.446236 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:59.446262 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:59.447492 (+ 1230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:59.451498 (+ 4006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:59.451502 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:59.451505 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:59.451897 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:59.452298 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:59.452300 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:59.452303 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:48:59.452427 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:48:59.452987 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:48:59.452990 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:48:59.453149 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 06:48:59.453274 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 06:48:59.453553 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":350,"threads_started":1}
I20260811 06:48:59.454094 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.439609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:53317 (local address 127.12.145.62:44355)
0811 06:48:59.439977 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.439983 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.440434 (+ 451us) server_negotiation.cc:407] Connection header received
0811 06:48:59.440603 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.440609 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.440674 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.440749 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:59.441743 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.442621 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.444503 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.445215 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.445350 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.447729 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:59.447736 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:59.447741 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:59.447780 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:59.451367 (+ 3587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:59.452018 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:59.452023 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:59.452028 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:59.452195 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:59.452512 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:59.452517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:59.452521 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:59.452889 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:59.453042 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.453409 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.453705 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232}
I20260811 06:48:59.462527 15336 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:44523
I20260811 06:48:59.462559 15561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:44523 every 8 connection(s)
I20260811 06:48:59.463807 15336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:48:59.465898 15562 heartbeater.cc:347] Connected to a master server at 127.12.145.62:44355
I20260811 06:48:59.466141 15562 heartbeater.cc:464] Registering TS with master...
I20260811 06:48:59.466399 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 15336
I20260811 06:48:59.466575 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:48:59.466962 15562 heartbeater.cc:511] Master 127.12.145.62:44355 requested a full tablet report, sending...
I20260811 06:48:59.467187 12868 external_mini_cluster.cc:1428] Setting key 7576662e2ffd5b26c28b93aad708ff5b
I20260811 06:48:59.468657 14758 ts_manager.cc:194] Registered new tserver with Master: 35d969f27e5c482d8ba74268dcaacbde (127.12.145.3:44523)
I20260811 06:48:59.469726 14758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:38481
I20260811 06:48:59.470317 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 06:48:59 dist-test-slave-7lbf krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430939, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 06:48:59 dist-test-slave-7lbf krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430939, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:48:59.518383 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.505476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40854 (local address 127.12.145.62:44355)
0811 06:48:59.505722 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.505729 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.505880 (+ 151us) server_negotiation.cc:407] Connection header received
0811 06:48:59.506042 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.506046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.506116 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.506201 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:59.507564 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.508339 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.509546 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.509960 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.510063 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.513662 (+ 3599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:59.513667 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:59.513670 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:59.513703 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:59.515962 (+ 2259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:59.516569 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:59.516574 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:59.516578 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:59.516742 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:48:59.517092 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:48:59.517096 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:48:59.517098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:48:59.517375 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:48:59.517619 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.517841 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.518025 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 06:48:59.522641 14758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:48:59.529465 14758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:48:59.564386 15589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.541825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:34541 (local address 127.0.0.1:60506)
0811 06:48:59.554618 (+ 12793us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:59.554661 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:59.554863 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:59.556718 (+ 1855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:59.556722 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:59.556752 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:59.557283 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.557297 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.558964 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.558977 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.561757 (+ 2780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.561771 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.563339 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.563345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.563534 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.563586 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 06:48:59.563728 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 06:48:59.563933 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12495,"mutex_wait_us":1,"thread_start_us":14400,"threads_started":1}
I20260811 06:48:59.564486 15587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.542128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60506 (local address 127.12.145.1:34541)
0811 06:48:59.556112 (+ 13984us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.556121 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.556152 (+ 31us) server_negotiation.cc:407] Connection header received
0811 06:48:59.556254 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.556261 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.556507 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.557490 (+ 983us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:59.557677 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.558827 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.561910 (+ 3083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.563131 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.563268 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.563489 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.563793 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.563961 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13804,"thread_start_us":14476,"threads_started":1}
I20260811 06:48:59.564934 15586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.542547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:42219 (local address 127.0.0.1:51876)
0811 06:48:59.556467 (+ 13920us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:59.556484 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:59.556613 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:59.557326 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:59.557331 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:59.557356 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:59.557749 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.557762 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.559620 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.559626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.562509 (+ 2883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.562521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.564126 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.564132 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.564313 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.564348 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 06:48:59.564439 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 06:48:59.564564 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13810,"mutex_wait_us":1,"thread_start_us":12666,"threads_started":1}
I20260811 06:48:59.565665 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.543421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51876 (local address 127.12.145.2:42219)
0811 06:48:59.554073 (+ 10652us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.554082 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.556762 (+ 2680us) server_negotiation.cc:407] Connection header received
0811 06:48:59.556871 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.556879 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.557118 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.557315 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:59.558083 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.559453 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.562646 (+ 3193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.563674 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.563793 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.563980 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.565198 (+ 1218us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.565371 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10488,"thread_start_us":10341,"threads_started":1}
I20260811 06:48:59.565980 15590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.542089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:44523 (local address 127.0.0.1:35222)
0811 06:48:59.555481 (+ 13392us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:59.555499 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:59.555624 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:59.556508 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:59.556516 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:59.556548 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:59.557164 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.557176 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.559360 (+ 2184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.559365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.562338 (+ 2973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.562354 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.564304 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.564954 (+ 650us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.565343 (+ 389us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.565377 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 06:48:59.565475 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 06:48:59.565628 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13263,"mutex_wait_us":56,"thread_start_us":12065,"threads_started":1}
I20260811 06:48:59.566018 15593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.542952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35222 (local address 127.12.145.3:44523)
0811 06:48:59.553599 (+ 10647us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.553610 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.555606 (+ 1996us) server_negotiation.cc:407] Connection header received
0811 06:48:59.555767 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.555777 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.556116 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.556329 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:59.557448 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.559193 (+ 1745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.562519 (+ 3326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.563787 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.563906 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.564141 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.565556 (+ 1415us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.565721 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10412,"thread_start_us":10200,"threads_started":1}
I20260811 06:48:59.568821 15223 tablet_service.cc:1467] Processing CreateTablet for tablet 8ea7729b1af24b478a014f870fe59309 (DEFAULT_TABLE table=test-table [id=6ce2ef763a5e4fdbb48e6239398596a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:48:59.568964 14983 tablet_service.cc:1467] Processing CreateTablet for tablet 8ea7729b1af24b478a014f870fe59309 (DEFAULT_TABLE table=test-table [id=6ce2ef763a5e4fdbb48e6239398596a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:48:59.569419 15439 tablet_service.cc:1467] Processing CreateTablet for tablet 8ea7729b1af24b478a014f870fe59309 (DEFAULT_TABLE table=test-table [id=6ce2ef763a5e4fdbb48e6239398596a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:48:59.570230 15223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ea7729b1af24b478a014f870fe59309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:59.570350 14983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ea7729b1af24b478a014f870fe59309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:59.570757 15439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ea7729b1af24b478a014f870fe59309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:59.582665 15597 tablet_bootstrap.cc:492] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: Bootstrap starting.
I20260811 06:48:59.585100 15599 tablet_bootstrap.cc:492] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: Bootstrap starting.
I20260811 06:48:59.587949 15597 tablet_bootstrap.cc:654] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:59.588734 15599 tablet_bootstrap.cc:654] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:59.589397 15597 log.cc:824] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: Log is configured to *not* fsync() on all Append() calls
I20260811 06:48:59.589624 15598 tablet_bootstrap.cc:492] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: Bootstrap starting.
I20260811 06:48:59.592733 15597 tablet_bootstrap.cc:492] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: No bootstrap required, opened a new log
I20260811 06:48:59.593047 15597 ts_tablet_manager.cc:1397] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260811 06:48:59.593111 15598 tablet_bootstrap.cc:654] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:59.594514 15598 log.cc:824] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: Log is configured to *not* fsync() on all Append() calls
I20260811 06:48:59.594533 15599 log.cc:824] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: Log is configured to *not* fsync() on all Append() calls
I20260811 06:48:59.597687 15599 tablet_bootstrap.cc:492] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: No bootstrap required, opened a new log
I20260811 06:48:59.597687 15598 tablet_bootstrap.cc:492] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: No bootstrap required, opened a new log
I20260811 06:48:59.597976 15598 ts_tablet_manager.cc:1397] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 06:48:59.597996 15599 ts_tablet_manager.cc:1397] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.002s
I20260811 06:48:59.601795 15597 raft_consensus.cc:348] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } }
I20260811 06:48:59.602195 15597 raft_consensus.cc:374] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:59.602303 15597 raft_consensus.cc:729] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99c5a7d2cd8a433682f1e31300002897, State: Initialized, Role: FOLLOWER
I20260811 06:48:59.602964 15597 consensus_queue.cc:260] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } }
I20260811 06:48:59.604086 15331 heartbeater.cc:503] Master 127.12.145.62:44355 was elected leader, sending a full tablet report...
I20260811 06:48:59.604790 15597 ts_tablet_manager.cc:1428] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260811 06:48:59.608774 15598 raft_consensus.cc:348] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } }
I20260811 06:48:59.608774 15599 raft_consensus.cc:348] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } }
I20260811 06:48:59.609225 15599 raft_consensus.cc:374] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:59.609225 15598 raft_consensus.cc:374] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:59.609333 15599 raft_consensus.cc:729] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35d969f27e5c482d8ba74268dcaacbde, State: Initialized, Role: FOLLOWER
I20260811 06:48:59.609333 15598 raft_consensus.cc:729] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd1944528ccc428eb244ff5af75d0a74, State: Initialized, Role: FOLLOWER
I20260811 06:48:59.609994 15599 consensus_queue.cc:260] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } }
I20260811 06:48:59.610005 15598 consensus_queue.cc:260] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } }
I20260811 06:48:59.611596 15562 heartbeater.cc:503] Master 127.12.145.62:44355 was elected leader, sending a full tablet report...
I20260811 06:48:59.611799 15598 ts_tablet_manager.cc:1428] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: Time spent starting tablet: real 0.014s user 0.009s sys 0.003s
I20260811 06:48:59.612150 15599 ts_tablet_manager.cc:1428] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: Time spent starting tablet: real 0.014s user 0.011s sys 0.002s
I20260811 06:48:59.616184 15605 raft_consensus.cc:482] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:48:59.616461 15605 raft_consensus.cc:504] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } }
I20260811 06:48:59.618043 15605 leader_election.cc:288] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35d969f27e5c482d8ba74268dcaacbde (127.12.145.3:44523), 99c5a7d2cd8a433682f1e31300002897 (127.12.145.2:42219)
I20260811 06:48:59.624289 15593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.618603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:37777 (local address 127.12.145.3:44523)
0811 06:48:59.618783 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.618789 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.619134 (+ 345us) server_negotiation.cc:407] Connection header received
0811 06:48:59.619300 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.619305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.619359 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.619429 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:59.619944 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.620749 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.622670 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.623428 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.623581 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.623654 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.623931 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.624063 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 06:48:59.624534 15608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.618247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:44523 (local address 127.12.145.1:37777)
0811 06:48:59.619039 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:59.619054 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:59.619180 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:59.619457 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:59.619461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:59.619496 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:59.619816 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.619826 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.620883 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.620887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.622523 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.622536 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.623647 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.623654 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.623787 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.623811 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 06:48:59.623892 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 06:48:59.624027 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"mutex_wait_us":1,"thread_start_us":538,"threads_started":1}
I20260811 06:48:59.625365 15469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ea7729b1af24b478a014f870fe59309" candidate_uuid: "cd1944528ccc428eb244ff5af75d0a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d969f27e5c482d8ba74268dcaacbde" is_pre_election: true
I20260811 06:48:59.625918 15469 raft_consensus.cc:2454] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd1944528ccc428eb244ff5af75d0a74 in term 0.
I20260811 06:48:59.626420 15609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.618412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:42219 (local address 127.12.145.1:52991)
0811 06:48:59.621243 (+ 2831us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:59.621260 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:59.621382 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:59.621713 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:59.621718 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:59.621741 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:59.622133 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.622142 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.623099 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.623103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.624510 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.624528 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.625722 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.625729 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.625862 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.625918 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 06:48:59.626010 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 06:48:59.626133 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2710,"thread_start_us":2471,"threads_started":1}
I20260811 06:48:59.626505 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.618545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:52991 (local address 127.12.145.2:42219)
0811 06:48:59.618773 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.618781 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.621344 (+ 2563us) server_negotiation.cc:407] Connection header received
0811 06:48:59.621509 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.621531 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.621599 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.621667 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:59.622280 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.622969 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.624671 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.625498 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.625680 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.625753 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.626067 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.626230 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 06:48:59.626421 15604 raft_consensus.cc:482] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:48:59.626737 15604 raft_consensus.cc:504] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } }
I20260811 06:48:59.627316 14908 leader_election.cc:302] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35d969f27e5c482d8ba74268dcaacbde, cd1944528ccc428eb244ff5af75d0a74; no voters:
I20260811 06:48:59.627709 15605 raft_consensus.cc:2781] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:48:59.627622 15251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ea7729b1af24b478a014f870fe59309" candidate_uuid: "cd1944528ccc428eb244ff5af75d0a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99c5a7d2cd8a433682f1e31300002897" is_pre_election: true
I20260811 06:48:59.627856 15605 raft_consensus.cc:482] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:48:59.627962 15605 raft_consensus.cc:3037] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:59.628085 15251 raft_consensus.cc:2454] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd1944528ccc428eb244ff5af75d0a74 in term 0.
I20260811 06:48:59.628928 15604 leader_election.cc:288] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd1944528ccc428eb244ff5af75d0a74 (127.12.145.1:34541), 35d969f27e5c482d8ba74268dcaacbde (127.12.145.3:44523)
I20260811 06:48:59.631115 15605 raft_consensus.cc:504] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } }
I20260811 06:48:59.631827 15605 leader_election.cc:288] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [CANDIDATE]: Term 1 election: Requested vote from peers 35d969f27e5c482d8ba74268dcaacbde (127.12.145.3:44523), 99c5a7d2cd8a433682f1e31300002897 (127.12.145.2:42219)
I20260811 06:48:59.632233 15251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ea7729b1af24b478a014f870fe59309" candidate_uuid: "cd1944528ccc428eb244ff5af75d0a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99c5a7d2cd8a433682f1e31300002897"
I20260811 06:48:59.632268 15469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ea7729b1af24b478a014f870fe59309" candidate_uuid: "cd1944528ccc428eb244ff5af75d0a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d969f27e5c482d8ba74268dcaacbde"
I20260811 06:48:59.632452 15469 raft_consensus.cc:3037] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:59.632457 15251 raft_consensus.cc:3037] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:59.635572 15469 raft_consensus.cc:2454] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd1944528ccc428eb244ff5af75d0a74 in term 1.
I20260811 06:48:59.636076 14908 leader_election.cc:302] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35d969f27e5c482d8ba74268dcaacbde, cd1944528ccc428eb244ff5af75d0a74; no voters:
I20260811 06:48:59.636212 15251 raft_consensus.cc:2454] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd1944528ccc428eb244ff5af75d0a74 in term 1.
I20260811 06:48:59.636538 15605 raft_consensus.cc:2781] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:48:59.637106 15605 raft_consensus.cc:686] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 1 LEADER]: Becoming Leader. State: Replica: cd1944528ccc428eb244ff5af75d0a74, State: Running, Role: LEADER
I20260811 06:48:59.637501 15587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.629652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:39037 (local address 127.12.145.1:34541)
0811 06:48:59.629834 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.629840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.630169 (+ 329us) server_negotiation.cc:407] Connection header received
0811 06:48:59.630342 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.630347 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.630415 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.630499 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:59.631105 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.632153 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.634918 (+ 2765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.636142 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.636281 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.636356 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.637138 (+ 782us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.637269 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 06:48:59.637753 15605 consensus_queue.cc:237] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } }
I20260811 06:48:59.638187 15611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.629109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:34541 (local address 127.12.145.2:39037)
0811 06:48:59.630056 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:59.630077 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:59.630219 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:59.630525 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:59.630541 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:59.630566 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:59.630952 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.630963 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.632286 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.632291 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.634717 (+ 2426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.634738 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.636749 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.636756 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.636935 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.636971 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 06:48:59.637608 (+ 637us) client_negotiation.cc:240] Negotiation successful
0811 06:48:59.637897 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"thread_start_us":590,"threads_started":1}
I20260811 06:48:59.639052 15027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ea7729b1af24b478a014f870fe59309" candidate_uuid: "99c5a7d2cd8a433682f1e31300002897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd1944528ccc428eb244ff5af75d0a74" is_pre_election: true
I20260811 06:48:59.643868 14758 catalog_manager.cc:5495] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd1944528ccc428eb244ff5af75d0a74 (127.12.145.1). New cstate: current_term: 1 leader_uuid: "cd1944528ccc428eb244ff5af75d0a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } health_report { overall_health: UNKNOWN } } }
I20260811 06:48:59.645319 15593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.629814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:38893 (local address 127.12.145.3:44523)
0811 06:48:59.629982 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.629987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.638881 (+ 8894us) server_negotiation.cc:407] Connection header received
0811 06:48:59.639144 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.639150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.639224 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.639289 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:48:59.639891 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.641344 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.643567 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.644519 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.644649 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.644704 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.645022 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.645128 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 06:48:59.646188 15611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.629301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:44523 (local address 127.12.145.2:38893)
0811 06:48:59.638791 (+ 9490us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:59.638811 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:59.638980 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:59.639513 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:59.639518 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:59.639546 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:48:59.639722 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.639734 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.641564 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.641569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.643383 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.643398 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.644680 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.644686 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.644855 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.644890 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 06:48:59.644998 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 06:48:59.645142 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9389,"thread_start_us":14223,"threads_started":1}
I20260811 06:48:59.646911 15469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ea7729b1af24b478a014f870fe59309" candidate_uuid: "99c5a7d2cd8a433682f1e31300002897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d969f27e5c482d8ba74268dcaacbde" is_pre_election: true
I20260811 06:48:59.647202 15469 raft_consensus.cc:2379] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99c5a7d2cd8a433682f1e31300002897 in current term 1: Already voted for candidate cd1944528ccc428eb244ff5af75d0a74 in this term.
I20260811 06:48:59.647897 15132 leader_election.cc:302] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99c5a7d2cd8a433682f1e31300002897; no voters: 35d969f27e5c482d8ba74268dcaacbde, cd1944528ccc428eb244ff5af75d0a74
I20260811 06:48:59.648401 15604 raft_consensus.cc:2726] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:48:59.688391 15096 tablet.cc:2369] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:48:59.696354 15587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.690370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60510 (local address 127.12.145.1:34541)
0811 06:48:59.690573 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.690581 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.690743 (+ 162us) server_negotiation.cc:407] Connection header received
0811 06:48:59.691154 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.691158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.691260 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.691396 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:48:59.691768 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.692520 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.693901 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.694303 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.694420 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.695043 (+ 623us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:48:59.695690 (+ 647us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:48:59.695831 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 06:48:59.695970 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 06:48:59.696057 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 06:48:59.697391 15332 tablet.cc:2369] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:48:59.705767 15251 raft_consensus.cc:1261] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 1 FOLLOWER]: Refusing update from remote peer cd1944528ccc428eb244ff5af75d0a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:48:59.706909 15614 consensus_queue.cc:1035] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:48:59.707336 15469 raft_consensus.cc:1261] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Refusing update from remote peer cd1944528ccc428eb244ff5af75d0a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:48:59.708139 15614 consensus_queue.cc:1035] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:48:59.715356 15563 tablet.cc:2369] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:48:59.741360 14758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:48:59.741737 14758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:48:59.746052 14758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88: Sending DeleteTablet for 3 replicas of tablet 8ea7729b1af24b478a014f870fe59309
I20260811 06:48:59.747251 15439 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ea7729b1af24b478a014f870fe59309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:48:59 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:35222
I20260811 06:48:59.747370 15223 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ea7729b1af24b478a014f870fe59309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:48:59 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:51876
I20260811 06:48:59.748087 14983 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ea7729b1af24b478a014f870fe59309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:48:59 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:60506
I20260811 06:48:59.749147 14758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:48:59.749996 14758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:48:59.752661 15636 tablet_replica.cc:330] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: stopping tablet replica
I20260811 06:48:59.753157 15636 raft_consensus.cc:2229] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:48:59.754045 15636 raft_consensus.cc:2258] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:48:59.754901 15635 tablet_replica.cc:330] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: stopping tablet replica
I20260811 06:48:59.755336 15635 raft_consensus.cc:2229] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:48:59.755875 15635 raft_consensus.cc:2258] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:48:59.756670 15634 tablet_replica.cc:330] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: stopping tablet replica
I20260811 06:48:59.756855 15636 ts_tablet_manager.cc:1905] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:48:59.757104 15634 raft_consensus.cc:2229] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:48:59.757637 15634 raft_consensus.cc:2258] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:48:59.758507 15438 tablet_service.cc:1467] Processing CreateTablet for tablet cfd5b081b18c4e54820b7c1acc4702c0 (DEFAULT_TABLE table=test-table [id=d23e0f5cf24c41c391afd30c1ca1be2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:48:59.758769 15223 tablet_service.cc:1467] Processing CreateTablet for tablet cfd5b081b18c4e54820b7c1acc4702c0 (DEFAULT_TABLE table=test-table [id=d23e0f5cf24c41c391afd30c1ca1be2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:48:59.758997 15438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfd5b081b18c4e54820b7c1acc4702c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:59.759174 15223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfd5b081b18c4e54820b7c1acc4702c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:59.761601 15634 ts_tablet_manager.cc:1905] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:48:59.765489 15597 tablet_bootstrap.cc:492] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897: Bootstrap starting.
I20260811 06:48:59.757886 14983 tablet_service.cc:1467] Processing CreateTablet for tablet cfd5b081b18c4e54820b7c1acc4702c0 (DEFAULT_TABLE table=test-table [id=d23e0f5cf24c41c391afd30c1ca1be2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:48:59.766294 14983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfd5b081b18c4e54820b7c1acc4702c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:48:59.767023 15635 ts_tablet_manager.cc:1905] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:48:59.767403 15597 tablet_bootstrap.cc:654] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:59.769878 15599 tablet_bootstrap.cc:492] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde: Bootstrap starting.
I20260811 06:48:59.771602 15599 tablet_bootstrap.cc:654] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:59.772696 15598 tablet_bootstrap.cc:492] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74: Bootstrap starting.
I20260811 06:48:59.773682 15634 ts_tablet_manager.cc:1918] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:48:59.773869 15634 log.cc:1196] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/8ea7729b1af24b478a014f870fe59309
I20260811 06:48:59.774248 15636 ts_tablet_manager.cc:1918] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:48:59.774506 15634 ts_tablet_manager.cc:1939] T 8ea7729b1af24b478a014f870fe59309 P 35d969f27e5c482d8ba74268dcaacbde: Deleting consensus metadata
I20260811 06:48:59.774441 15598 tablet_bootstrap.cc:654] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74: Neither blocks nor log segments found. Creating new log.
I20260811 06:48:59.774907 15636 log.cc:1196] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/8ea7729b1af24b478a014f870fe59309
I20260811 06:48:59.775832 15636 ts_tablet_manager.cc:1939] T 8ea7729b1af24b478a014f870fe59309 P cd1944528ccc428eb244ff5af75d0a74: Deleting consensus metadata
I20260811 06:48:59.777967 15597 tablet_bootstrap.cc:492] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897: No bootstrap required, opened a new log
I20260811 06:48:59.778172 15597 ts_tablet_manager.cc:1397] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.009s
I20260811 06:48:59.778522 14736 catalog_manager.cc:4841] TS 35d969f27e5c482d8ba74268dcaacbde (127.12.145.3:44523): tablet 8ea7729b1af24b478a014f870fe59309 (table test-table [id=6ce2ef763a5e4fdbb48e6239398596a8]) successfully deleted
I20260811 06:48:59.779166 15597 raft_consensus.cc:348] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:48:59.779564 15597 raft_consensus.cc:374] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:59.779731 15597 raft_consensus.cc:729] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99c5a7d2cd8a433682f1e31300002897, State: Initialized, Role: FOLLOWER
I20260811 06:48:59.780071 15597 consensus_queue.cc:260] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:48:59.780261 15598 tablet_bootstrap.cc:492] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74: No bootstrap required, opened a new log
I20260811 06:48:59.780423 15598 ts_tablet_manager.cc:1397] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20260811 06:48:59.781266 15598 raft_consensus.cc:348] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:48:59.781487 15598 raft_consensus.cc:374] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:59.781641 15598 raft_consensus.cc:729] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd1944528ccc428eb244ff5af75d0a74, State: Initialized, Role: FOLLOWER
I20260811 06:48:59.781955 15598 consensus_queue.cc:260] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:48:59.782205 14740 catalog_manager.cc:4841] TS cd1944528ccc428eb244ff5af75d0a74 (127.12.145.1:34541): tablet 8ea7729b1af24b478a014f870fe59309 (table test-table [id=6ce2ef763a5e4fdbb48e6239398596a8]) successfully deleted
I20260811 06:48:59.782815 15597 ts_tablet_manager.cc:1428] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260811 06:48:59.784633 15598 ts_tablet_manager.cc:1428] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260811 06:48:59.786252 15599 tablet_bootstrap.cc:492] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde: No bootstrap required, opened a new log
I20260811 06:48:59.786736 15599 ts_tablet_manager.cc:1397] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.001s
I20260811 06:48:59.787251 15635 ts_tablet_manager.cc:1918] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:48:59.787432 15635 log.cc:1196] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/8ea7729b1af24b478a014f870fe59309
I20260811 06:48:59.787675 15599 raft_consensus.cc:348] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:48:59.787868 15599 raft_consensus.cc:374] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:48:59.787966 15599 raft_consensus.cc:729] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35d969f27e5c482d8ba74268dcaacbde, State: Initialized, Role: FOLLOWER
I20260811 06:48:59.788030 15635 ts_tablet_manager.cc:1939] T 8ea7729b1af24b478a014f870fe59309 P 99c5a7d2cd8a433682f1e31300002897: Deleting consensus metadata
I20260811 06:48:59.788205 15599 consensus_queue.cc:260] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:48:59.788710 15599 ts_tablet_manager.cc:1428] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:48:59.789865 14735 catalog_manager.cc:4841] TS 99c5a7d2cd8a433682f1e31300002897 (127.12.145.2:42219): tablet 8ea7729b1af24b478a014f870fe59309 (table test-table [id=6ce2ef763a5e4fdbb48e6239398596a8]) successfully deleted
I20260811 06:48:59.916617 15604 raft_consensus.cc:482] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:48:59.916863 15604 raft_consensus.cc:504] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:48:59.917654 15604 leader_election.cc:288] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd1944528ccc428eb244ff5af75d0a74 (127.12.145.1:34541), 35d969f27e5c482d8ba74268dcaacbde (127.12.145.3:44523)
I20260811 06:48:59.918190 15027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfd5b081b18c4e54820b7c1acc4702c0" candidate_uuid: "99c5a7d2cd8a433682f1e31300002897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd1944528ccc428eb244ff5af75d0a74" is_pre_election: true
I20260811 06:48:59.918385 15469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfd5b081b18c4e54820b7c1acc4702c0" candidate_uuid: "99c5a7d2cd8a433682f1e31300002897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d969f27e5c482d8ba74268dcaacbde" is_pre_election: true
I20260811 06:48:59.918524 15027 raft_consensus.cc:2454] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99c5a7d2cd8a433682f1e31300002897 in term 0.
I20260811 06:48:59.918663 15469 raft_consensus.cc:2454] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99c5a7d2cd8a433682f1e31300002897 in term 0.
I20260811 06:48:59.919059 15136 leader_election.cc:302] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99c5a7d2cd8a433682f1e31300002897, cd1944528ccc428eb244ff5af75d0a74; no voters:
I20260811 06:48:59.919332 15604 raft_consensus.cc:2781] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:48:59.919438 15604 raft_consensus.cc:482] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:48:59.919523 15604 raft_consensus.cc:3037] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:59.922047 15604 raft_consensus.cc:504] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:48:59.922572 15604 leader_election.cc:288] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [CANDIDATE]: Term 1 election: Requested vote from peers cd1944528ccc428eb244ff5af75d0a74 (127.12.145.1:34541), 35d969f27e5c482d8ba74268dcaacbde (127.12.145.3:44523)
I20260811 06:48:59.923015 15027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfd5b081b18c4e54820b7c1acc4702c0" candidate_uuid: "99c5a7d2cd8a433682f1e31300002897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd1944528ccc428eb244ff5af75d0a74"
I20260811 06:48:59.923122 15469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfd5b081b18c4e54820b7c1acc4702c0" candidate_uuid: "99c5a7d2cd8a433682f1e31300002897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d969f27e5c482d8ba74268dcaacbde"
I20260811 06:48:59.923262 15027 raft_consensus.cc:3037] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:59.923318 15469 raft_consensus.cc:3037] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:48:59.926324 15469 raft_consensus.cc:2454] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99c5a7d2cd8a433682f1e31300002897 in term 1.
I20260811 06:48:59.926702 15027 raft_consensus.cc:2454] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99c5a7d2cd8a433682f1e31300002897 in term 1.
I20260811 06:48:59.926792 15132 leader_election.cc:302] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35d969f27e5c482d8ba74268dcaacbde, 99c5a7d2cd8a433682f1e31300002897; no voters:
I20260811 06:48:59.927086 15604 raft_consensus.cc:2781] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:48:59.927631 15604 raft_consensus.cc:686] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 1 LEADER]: Becoming Leader. State: Replica: 99c5a7d2cd8a433682f1e31300002897, State: Running, Role: LEADER
I20260811 06:48:59.928076 15604 consensus_queue.cc:237] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:48:59.931931 14759 catalog_manager.cc:5495] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99c5a7d2cd8a433682f1e31300002897 (127.12.145.2). New cstate: current_term: 1 leader_uuid: "99c5a7d2cd8a433682f1e31300002897" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } health_report { overall_health: UNKNOWN } } }
Aug 11 06:48:59 dist-test-slave-7lbf krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430937, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:00.002141 15655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.988456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:44355 (local address 127.0.0.1:40860)
0811 06:48:59.989183 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0811 06:48:59.989202 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:48:59.989353 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:48:59.989740 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:48:59.989744 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:48:59.990519 (+ 775us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:48:59.990812 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.990822 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.991821 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.991826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.992884 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:48:59.992898 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.993649 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.993656 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:48:59.993811 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.994436 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:48:59.994455 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:48:59.996737 (+ 2282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:48:59.999618 (+ 2881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:48:59.999630 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:48:59.999638 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:00.000025 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:00.000371 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:00.000376 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:00.000380 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:00.000522 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:00.001136 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:00.001144 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:00.001310 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 06:49:00.001451 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 06:49:00.001795 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":404,"threads_started":1}
I20260811 06:49:00.002439 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:48:59.988442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40860 (local address 127.12.145.62:44355)
0811 06:48:59.988652 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 06:48:59.988659 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:48:59.989306 (+ 647us) server_negotiation.cc:407] Connection header received
0811 06:48:59.989465 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:48:59.989470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:48:59.989590 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:48:59.989681 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:48:59.990957 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.991695 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.993028 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:48:59.993450 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:48:59.993586 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:48:59.996905 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:48:59.996910 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:48:59.996913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:48:59.996942 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:48:59.999491 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.000136 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.000141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.000143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.000259 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.000621 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.000626 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.000629 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.000998 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:00.001125 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:00.001591 (+ 466us) server_negotiation.cc:299] Negotiation successful
0811 06:49:00.002014 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":156,"server-negotiator.queue_time_us":69}
I20260811 06:49:00.008555 14759 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:40860:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 06:49:00.010174 14759 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:49:00.017768 14983 tablet_service.cc:1467] Processing CreateTablet for tablet 58bee0336c35438686460f01981a3cee (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b60093dd802f4631ae97b91aa5717f9a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 06:49:00.018138 15438 tablet_service.cc:1467] Processing CreateTablet for tablet 58bee0336c35438686460f01981a3cee (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b60093dd802f4631ae97b91aa5717f9a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 06:49:00.018503 14983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58bee0336c35438686460f01981a3cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:00.018435 15223 tablet_service.cc:1467] Processing CreateTablet for tablet 58bee0336c35438686460f01981a3cee (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b60093dd802f4631ae97b91aa5717f9a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 06:49:00.018674 15438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58bee0336c35438686460f01981a3cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:00.019009 15223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58bee0336c35438686460f01981a3cee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:00.026217 15598 tablet_bootstrap.cc:492] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: Bootstrap starting.
I20260811 06:49:00.028064 15598 tablet_bootstrap.cc:654] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:00.028509 15599 tablet_bootstrap.cc:492] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: Bootstrap starting.
I20260811 06:49:00.030386 15599 tablet_bootstrap.cc:654] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:00.030768 15598 tablet_bootstrap.cc:492] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: No bootstrap required, opened a new log
I20260811 06:49:00.030975 15598 ts_tablet_manager.cc:1397] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260811 06:49:00.031773 15598 raft_consensus.cc:348] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:49:00.032052 15598 raft_consensus.cc:374] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:00.032141 15598 raft_consensus.cc:729] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd1944528ccc428eb244ff5af75d0a74, State: Initialized, Role: FOLLOWER
I20260811 06:49:00.032171 15599 tablet_bootstrap.cc:492] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: No bootstrap required, opened a new log
I20260811 06:49:00.032378 15599 ts_tablet_manager.cc:1397] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260811 06:49:00.032400 15598 consensus_queue.cc:260] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:49:00.032971 15614 tablet_replica.cc:439] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } }
I20260811 06:49:00.033455 15614 tablet_replica.cc:442] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:00.033990 15598 ts_tablet_manager.cc:1428] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 06:49:00.033905 15599 raft_consensus.cc:348] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:49:00.034154 15599 raft_consensus.cc:374] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:00.034243 15599 raft_consensus.cc:729] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35d969f27e5c482d8ba74268dcaacbde, State: Initialized, Role: FOLLOWER
I20260811 06:49:00.034554 15597 tablet_bootstrap.cc:492] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: Bootstrap starting.
I20260811 06:49:00.034529 15599 consensus_queue.cc:260] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:49:00.034961 15606 tablet_replica.cc:439] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } }
I20260811 06:49:00.035281 15606 tablet_replica.cc:442] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:00.036345 15597 tablet_bootstrap.cc:654] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:00.037449 15599 ts_tablet_manager.cc:1428] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260811 06:49:00.043110 15597 tablet_bootstrap.cc:492] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: No bootstrap required, opened a new log
I20260811 06:49:00.043310 15597 ts_tablet_manager.cc:1397] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.005s
I20260811 06:49:00.044212 15597 raft_consensus.cc:348] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:49:00.044474 15597 raft_consensus.cc:374] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:00.044559 15597 raft_consensus.cc:729] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99c5a7d2cd8a433682f1e31300002897, State: Initialized, Role: FOLLOWER
I20260811 06:49:00.044824 15597 consensus_queue.cc:260] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:49:00.045285 15604 tablet_replica.cc:439] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } }
I20260811 06:49:00.045562 15604 tablet_replica.cc:442] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:00.046046 15597 ts_tablet_manager.cc:1428] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 06:49:00.242479 15604 raft_consensus.cc:482] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:00.242698 15604 raft_consensus.cc:504] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:49:00.243353 15604 leader_election.cc:288] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd1944528ccc428eb244ff5af75d0a74 (127.12.145.1:34541), 35d969f27e5c482d8ba74268dcaacbde (127.12.145.3:44523)
I20260811 06:49:00.243927 15027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bee0336c35438686460f01981a3cee" candidate_uuid: "99c5a7d2cd8a433682f1e31300002897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd1944528ccc428eb244ff5af75d0a74" is_pre_election: true
I20260811 06:49:00.243954 15469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bee0336c35438686460f01981a3cee" candidate_uuid: "99c5a7d2cd8a433682f1e31300002897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d969f27e5c482d8ba74268dcaacbde" is_pre_election: true
I20260811 06:49:00.244164 15027 raft_consensus.cc:2454] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99c5a7d2cd8a433682f1e31300002897 in term 0.
I20260811 06:49:00.244226 15469 raft_consensus.cc:2454] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99c5a7d2cd8a433682f1e31300002897 in term 0.
I20260811 06:49:00.244602 15136 leader_election.cc:302] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99c5a7d2cd8a433682f1e31300002897, cd1944528ccc428eb244ff5af75d0a74; no voters:
I20260811 06:49:00.244870 15604 raft_consensus.cc:2781] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:49:00.244957 15604 raft_consensus.cc:482] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:49:00.245038 15604 raft_consensus.cc:3037] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:00.246956 15604 raft_consensus.cc:504] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:49:00.247623 15604 leader_election.cc:288] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [CANDIDATE]: Term 1 election: Requested vote from peers cd1944528ccc428eb244ff5af75d0a74 (127.12.145.1:34541), 35d969f27e5c482d8ba74268dcaacbde (127.12.145.3:44523)
I20260811 06:49:00.248112 15027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bee0336c35438686460f01981a3cee" candidate_uuid: "99c5a7d2cd8a433682f1e31300002897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd1944528ccc428eb244ff5af75d0a74"
I20260811 06:49:00.248324 15027 raft_consensus.cc:3037] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:00.248250 15469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bee0336c35438686460f01981a3cee" candidate_uuid: "99c5a7d2cd8a433682f1e31300002897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d969f27e5c482d8ba74268dcaacbde"
I20260811 06:49:00.248494 15469 raft_consensus.cc:3037] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:00.251258 15469 raft_consensus.cc:2454] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99c5a7d2cd8a433682f1e31300002897 in term 1.
I20260811 06:49:00.251283 15027 raft_consensus.cc:2454] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99c5a7d2cd8a433682f1e31300002897 in term 1.
I20260811 06:49:00.251662 15132 leader_election.cc:302] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35d969f27e5c482d8ba74268dcaacbde, 99c5a7d2cd8a433682f1e31300002897; no voters:
I20260811 06:49:00.251924 15604 raft_consensus.cc:2781] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:00.252082 15604 raft_consensus.cc:686] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [term 1 LEADER]: Becoming Leader. State: Replica: 99c5a7d2cd8a433682f1e31300002897, State: Running, Role: LEADER
I20260811 06:49:00.252315 15604 consensus_queue.cc:237] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } }
I20260811 06:49:00.253824 15644 tablet_replica.cc:439] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: TxnStatusTablet state changed. Reason: New leader 99c5a7d2cd8a433682f1e31300002897. Latest consensus state: current_term: 1 leader_uuid: "99c5a7d2cd8a433682f1e31300002897" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } }
I20260811 06:49:00.254093 15644 tablet_replica.cc:442] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: This TxnStatusTablet replica's current role is: LEADER
I20260811 06:49:00.254745 15664 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 06:49:00.255072 15664 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 06:49:00.255357 14758 catalog_manager.cc:5495] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99c5a7d2cd8a433682f1e31300002897 (127.12.145.2). New cstate: current_term: 1 leader_uuid: "99c5a7d2cd8a433682f1e31300002897" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } health_report { overall_health: UNKNOWN } } }
I20260811 06:49:00.294121 15655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:00.288152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:42219 (local address 127.0.0.1:51888)
0811 06:49:00.288375 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:00.288393 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:00.288542 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:00.289224 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:00.289229 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:00.289243 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:49:00.289435 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:00.289445 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.290691 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.290697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:00.291715 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:00.291727 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.292442 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.292448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:00.292622 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:00.292679 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:49:00.293568 (+ 889us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:49:00.293592 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 06:49:00.293675 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 06:49:00.293822 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 06:49:00.294183 15670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:00.288296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51888 (local address 127.12.145.2:42219)
0811 06:49:00.288859 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:00.288863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:00.288877 (+ 14us) server_negotiation.cc:407] Connection header received
0811 06:49:00.288957 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:00.288960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:00.289042 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:00.289179 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:00.289621 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.290560 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.291857 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.292293 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.292400 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:00.292884 (+ 484us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:00.293437 (+ 553us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:00.293601 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:00.293723 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 06:49:00.293804 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":272,"threads_started":1}
I20260811 06:49:00.299197 15469 raft_consensus.cc:1261] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Refusing update from remote peer 99c5a7d2cd8a433682f1e31300002897: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:00.299639 15027 raft_consensus.cc:1261] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74 [term 1 FOLLOWER]: Refusing update from remote peer 99c5a7d2cd8a433682f1e31300002897: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:00.299926 15604 consensus_queue.cc:1035] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:00.300493 15644 consensus_queue.cc:1035] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:00.304425 15614 tablet_replica.cc:439] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: TxnStatusTablet state changed. Reason: New leader 99c5a7d2cd8a433682f1e31300002897. Latest consensus state: current_term: 1 leader_uuid: "99c5a7d2cd8a433682f1e31300002897" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } }
I20260811 06:49:00.304728 15614 tablet_replica.cc:442] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:00.306843 15673 mvcc.cc:205] Tried to move back new op lower bound from 7317221131458920448 to 7317221131275485184. Current Snapshot: MvccSnapshot[applied={T|T < 7317221131458920448}]
I20260811 06:49:00.308713 15678 mvcc.cc:205] Tried to move back new op lower bound from 7317221131458920448 to 7317221131275485184. Current Snapshot: MvccSnapshot[applied={T|T < 7317221131458920448}]
I20260811 06:49:00.310175 15644 tablet_replica.cc:439] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "99c5a7d2cd8a433682f1e31300002897" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } }
I20260811 06:49:00.310602 15644 tablet_replica.cc:442] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: This TxnStatusTablet replica's current role is: LEADER
I20260811 06:49:00.314922 15606 tablet_replica.cc:439] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: TxnStatusTablet state changed. Reason: New leader 99c5a7d2cd8a433682f1e31300002897. Latest consensus state: current_term: 1 leader_uuid: "99c5a7d2cd8a433682f1e31300002897" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } }
I20260811 06:49:00.315201 15606 tablet_replica.cc:442] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:00.316793 15644 tablet_replica.cc:439] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "99c5a7d2cd8a433682f1e31300002897" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } }
I20260811 06:49:00.317129 15644 tablet_replica.cc:442] T 58bee0336c35438686460f01981a3cee P 99c5a7d2cd8a433682f1e31300002897: This TxnStatusTablet replica's current role is: LEADER
I20260811 06:49:00.325244 15614 tablet_replica.cc:439] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "99c5a7d2cd8a433682f1e31300002897" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } }
I20260811 06:49:00.325554 15614 tablet_replica.cc:442] T 58bee0336c35438686460f01981a3cee P cd1944528ccc428eb244ff5af75d0a74: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:00.330466 15606 tablet_replica.cc:439] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "99c5a7d2cd8a433682f1e31300002897" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 } } peers { permanent_uuid: "99c5a7d2cd8a433682f1e31300002897" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42219 } } peers { permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 } } }
I20260811 06:49:00.330788 15606 tablet_replica.cc:442] T 58bee0336c35438686460f01981a3cee P 35d969f27e5c482d8ba74268dcaacbde: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:00.336459 15670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:00.322661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51902 (local address 127.12.145.2:42219)
0811 06:49:00.322841 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:00.322848 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:00.330233 (+ 7385us) server_negotiation.cc:407] Connection header received
0811 06:49:00.330551 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:00.330557 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:00.330642 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:00.330706 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:00.331492 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.332701 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.334363 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.335053 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.335205 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:00.335635 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:00.335781 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:00.335893 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:00.336007 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 06:49:00.336128 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 06:49:00.354364 15670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:00.348125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:58483 (local address 127.12.145.2:42219)
0811 06:49:00.348338 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:00.348345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:00.349030 (+ 685us) server_negotiation.cc:407] Connection header received
0811 06:49:00.349335 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:00.349341 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:00.349433 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:00.349508 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:00.350205 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.351010 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.352576 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.353112 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.353222 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:00.353657 (+ 435us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:00.353757 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:00.353828 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:00.353948 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 06:49:00.354015 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:49:00.354423 15691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:00.348139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:42219 (local address 127.12.145.2:58483)
0811 06:49:00.348916 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:00.348937 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:00.349142 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:00.349654 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:00.349658 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:00.349670 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:49:00.350001 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:00.350010 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.351144 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.351148 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:00.352447 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:00.352460 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.353291 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.353296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:00.353421 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:00.353478 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:49:00.353840 (+ 362us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:49:00.353851 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 06:49:00.353920 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 06:49:00.354062 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":401,"threads_started":1}
I20260811 06:49:00.366480 15027 raft_consensus.cc:1261] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74 [term 1 FOLLOWER]: Refusing update from remote peer 99c5a7d2cd8a433682f1e31300002897: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:00.366560 15469 raft_consensus.cc:1261] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Refusing update from remote peer 99c5a7d2cd8a433682f1e31300002897: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:00.367095 15682 consensus_queue.cc:1035] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd1944528ccc428eb244ff5af75d0a74" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:00.367415 15604 consensus_queue.cc:1035] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35d969f27e5c482d8ba74268dcaacbde" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:00.377564 15676 mvcc.cc:205] Tried to move back new op lower bound from 7317221131735289856 to 7317221129949913088. Current Snapshot: MvccSnapshot[applied={T|T < 7317221131735289856}]
I20260811 06:49:00.474077 14759 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:00.474351 14759 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:00.478221 14759 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b40ddbcda804b0dbd8574436cdbde88: Sending DeleteTablet for 3 replicas of tablet cfd5b081b18c4e54820b7c1acc4702c0
I20260811 06:49:00.479368 15438 tablet_service.cc:1514] Processing DeleteTablet for tablet cfd5b081b18c4e54820b7c1acc4702c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:00 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:35222
I20260811 06:49:00.480091 15222 tablet_service.cc:1514] Processing DeleteTablet for tablet cfd5b081b18c4e54820b7c1acc4702c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:00 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:51876
I20260811 06:49:00.480957 14983 tablet_service.cc:1514] Processing DeleteTablet for tablet cfd5b081b18c4e54820b7c1acc4702c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:00 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:60506
I20260811 06:49:00.485956 15696 tablet_replica.cc:330] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde: stopping tablet replica
I20260811 06:49:00.486212 15696 raft_consensus.cc:2229] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:00.486533 15696 raft_consensus.cc:2258] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:00.487231 15700 tablet_replica.cc:330] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74: stopping tablet replica
I20260811 06:49:00.487449 15700 raft_consensus.cc:2229] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:00.487716 15700 raft_consensus.cc:2258] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:00.488692 15696 ts_tablet_manager.cc:1905] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:00.494371 15699 tablet_replica.cc:330] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897: stopping tablet replica
I20260811 06:49:00.494601 15699 raft_consensus.cc:2229] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:49:00.495276 15699 raft_consensus.cc:2258] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:00.497001 15696 ts_tablet_manager.cc:1918] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:49:00.497152 15696 log.cc:1196] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/cfd5b081b18c4e54820b7c1acc4702c0
I20260811 06:49:00.497357 15699 ts_tablet_manager.cc:1905] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:00.506428 15700 ts_tablet_manager.cc:1905] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:00.507681 15699 ts_tablet_manager.cc:1918] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:49:00.507853 15699 log.cc:1196] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/cfd5b081b18c4e54820b7c1acc4702c0
I20260811 06:49:00.508427 15699 ts_tablet_manager.cc:1939] T cfd5b081b18c4e54820b7c1acc4702c0 P 99c5a7d2cd8a433682f1e31300002897: Deleting consensus metadata
I20260811 06:49:00.509806 14735 catalog_manager.cc:4841] TS 99c5a7d2cd8a433682f1e31300002897 (127.12.145.2:42219): tablet cfd5b081b18c4e54820b7c1acc4702c0 (table test-table [id=d23e0f5cf24c41c391afd30c1ca1be2b]) successfully deleted
I20260811 06:49:00.513942 15700 ts_tablet_manager.cc:1918] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:49:00.514096 15700 log.cc:1196] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/cfd5b081b18c4e54820b7c1acc4702c0
I20260811 06:49:00.514605 15700 ts_tablet_manager.cc:1939] T cfd5b081b18c4e54820b7c1acc4702c0 P cd1944528ccc428eb244ff5af75d0a74: Deleting consensus metadata
I20260811 06:49:00.515797 14740 catalog_manager.cc:4841] TS cd1944528ccc428eb244ff5af75d0a74 (127.12.145.1:34541): tablet cfd5b081b18c4e54820b7c1acc4702c0 (table test-table [id=d23e0f5cf24c41c391afd30c1ca1be2b]) successfully deleted
I20260811 06:49:00.517853 15696 ts_tablet_manager.cc:1939] T cfd5b081b18c4e54820b7c1acc4702c0 P 35d969f27e5c482d8ba74268dcaacbde: Deleting consensus metadata
I20260811 06:49:00.519097 14736 catalog_manager.cc:4841] TS 35d969f27e5c482d8ba74268dcaacbde (127.12.145.3:44523): tablet cfd5b081b18c4e54820b7c1acc4702c0 (table test-table [id=d23e0f5cf24c41c391afd30c1ca1be2b]) successfully deleted
Aug 11 06:49:00 dist-test-slave-7lbf krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430939, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:49:00.530337 15704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:00.496137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60512 (local address 127.12.145.1:34541)
0811 06:49:00.510520 (+ 14383us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:00.510527 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:00.510579 (+ 52us) server_negotiation.cc:407] Connection header received
0811 06:49:00.510684 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:00.510691 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:00.510791 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:00.510933 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:00.512983 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.514411 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.516463 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.517140 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.517255 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:00.523023 (+ 5768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:00.523042 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:00.523062 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:00.523114 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:00.527240 (+ 4126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.528015 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.528025 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.528029 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.528208 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.528551 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.528557 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.528560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.529051 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:00.529345 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:00.529630 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 06:49:00.529875 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14214,"thread_start_us":14054,"threads_started":1}
W20260811 06:49:00.531101 15087 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60512
I20260811 06:49:00.548158 15710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:00.534498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40868 (local address 127.12.145.62:44355)
0811 06:49:00.535065 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:00.535069 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:00.535087 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:49:00.535147 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:00.535151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:00.535216 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:00.535344 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:00.536956 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.537760 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.539474 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.539893 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.539987 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:00.542648 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:00.542653 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:00.542656 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:00.542689 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:00.545209 (+ 2520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.546009 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.546014 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.546016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.546240 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.546696 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.546700 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.546703 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.547024 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:00.547250 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:00.547584 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 06:49:00.547765 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":289,"threads_started":1}
W20260811 06:49:00.548929 14759 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40868
I20260811 06:49:00.552022 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 14884
I20260811 06:49:00.566045 15704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:00.552858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60520 (local address 127.12.145.1:34541)
0811 06:49:00.553184 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:00.553191 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:00.553479 (+ 288us) server_negotiation.cc:407] Connection header received
0811 06:49:00.553690 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:00.553696 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:00.553785 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:00.553901 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:00.555070 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.556115 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.557312 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.557991 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.558130 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:00.560532 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:00.560540 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:00.560545 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:00.560590 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:00.563391 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.564173 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.564176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.564179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.564300 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.564717 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.564722 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.564724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.565003 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:00.565249 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:00.565612 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 06:49:00.565792 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 06:49:00.566639 15087 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60520
W20260811 06:49:00.567224 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 14884: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:49:00.567446 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 14884
I20260811 06:49:00.594084 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15102
Aug 11 06:49:00 dist-test-slave-7lbf krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430939, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:49:00.611210 15670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:00.594927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51908 (local address 127.12.145.2:42219)
0811 06:49:00.595100 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:00.595106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:00.595126 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:49:00.595355 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:00.595360 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:00.595427 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:00.595511 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:00.597098 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.597946 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.599753 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.600259 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.600358 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:00.605168 (+ 4810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:00.605180 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:00.605195 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:00.605232 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:00.608166 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.608871 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.608879 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.608881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.609037 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.609421 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.609424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.609426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.609998 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:00.610331 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:00.610642 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 06:49:00.610892 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 06:49:00.611918 15324 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51908
W20260811 06:49:00.612594 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15102: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:49:00.612736 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 15102
I20260811 06:49:00.637785 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15336
Aug 11 06:49:00 dist-test-slave-7lbf krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430939, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:49:00.652456 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:00.638585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35232 (local address 127.12.145.3:44523)
0811 06:49:00.639067 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:00.639071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:00.639088 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:49:00.639144 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:00.639148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:00.639206 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:00.639297 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:00.640791 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.641480 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.642672 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:00.643129 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:00.643228 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:00.647119 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:00.647135 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:00.647154 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:00.647190 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:00.650106 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.650727 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.650733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.650735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.650860 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:00.651146 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:00.651149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:00.651151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:00.651514 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:00.651738 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:00.651926 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 06:49:00.652107 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":279,"threads_started":1}
W20260811 06:49:00.653280 15555 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35232
W20260811 06:49:00.654011 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15336: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:49:00.654171 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 15336
I20260811 06:49:00.682365 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 14709
I20260811 06:49:00.683617 14823 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:00.801553 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 14709
2026-08-11T06:49:00Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4830 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:49:00 dist-test-slave-7lbf krb5kdc[15719](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:49:00 dist-test-slave-7lbf krb5kdc[15719](info): set up 2 sockets
Aug 11 06:49:00 dist-test-slave-7lbf krb5kdc[15719](info): commencing operation
krb5kdc: starting...
W20260811 06:49:02.024896 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.005s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:49:02 dist-test-slave-7lbf krb5kdc[15719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:49:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:49:02.229820 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:34353
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:34353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:02.565644 15738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:02.565979 15738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:02.566111 15738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:02.573479 15738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:02.573653 15738 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 06:49:02.573724 15738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:02.573812 15738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:02.573881 15738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:02.573967 15738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:02.584195 15738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:34353
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:34353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:02.585652 15738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:02.587006 15738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:02.601802 15748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:02.601918 15751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:02.601884 15756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:02.603492 15738 server_base.cc:1034] running on GCE node
I20260811 06:49:02.604293 15738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:02.605818 15738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:02.607029 15738 hybrid_clock.cc:648] HybridClock initialized: now 1786430942606959 us; error 50 us; skew 500 ppm
I20260811 06:49:02.607368 15738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:02 dist-test-slave-7lbf krb5kdc[15719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430942, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:02.614167 15738 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:49:02.615761 15738 webserver.cc:460] Webserver started at http://127.12.145.62:37153/ using document root <none> and password file <none>
I20260811 06:49:02.616501 15738 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:02.616595 15738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:02.616878 15738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:02.620177 15738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "e37dee8602ce42128852753d9139f40d"
format_stamp: "Formatted at 2026-08-11 06:49:02 on dist-test-slave-7lbf"
server_key: "dd5e90a691783e19d97b6c409744afe0"
server_key_iv: "020fd39f2b8dd82c5acdeef4854005e6"
server_key_version: "encryptionkey@0"
I20260811 06:49:02.620961 15738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "e37dee8602ce42128852753d9139f40d"
format_stamp: "Formatted at 2026-08-11 06:49:02 on dist-test-slave-7lbf"
server_key: "dd5e90a691783e19d97b6c409744afe0"
server_key_iv: "020fd39f2b8dd82c5acdeef4854005e6"
server_key_version: "encryptionkey@0"
I20260811 06:49:02.626525 15738 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 06:49:02.630226 15767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:02.631639 15738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:02.631815 15738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "e37dee8602ce42128852753d9139f40d"
format_stamp: "Formatted at 2026-08-11 06:49:02 on dist-test-slave-7lbf"
server_key: "dd5e90a691783e19d97b6c409744afe0"
server_key_iv: "020fd39f2b8dd82c5acdeef4854005e6"
server_key_version: "encryptionkey@0"
I20260811 06:49:02.632045 15738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:02.644464 15738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:02.649004 15738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:02.649335 15738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:02.670562 15738 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:34353
I20260811 06:49:02.670568 15875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:34353 every 8 connection(s)
I20260811 06:49:02.672183 15738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:02.676127 15876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:02.680337 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 15738
I20260811 06:49:02.680544 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:02.681164 12868 external_mini_cluster.cc:1428] Setting key f774ba8cbb521433f351466abd6e85ca
I20260811 06:49:02.688549 15876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d: Bootstrap starting.
I20260811 06:49:02.692322 15876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:02.693709 15876 log.cc:824] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:02.696563 15876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d: No bootstrap required, opened a new log
Aug 11 06:49:02 dist-test-slave-7lbf krb5kdc[15719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:02.706064 15882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:02.683260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37886 (local address 127.12.145.62:34353)
0811 06:49:02.684147 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:02.684167 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:02.684223 (+ 56us) server_negotiation.cc:407] Connection header received
0811 06:49:02.686697 (+ 2474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:02.686730 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:02.687273 (+ 543us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:02.687760 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:02.689169 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:02.691183 (+ 2014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:02.692534 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:02.693647 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:02.693841 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:02.698038 (+ 4197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:02.698050 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:02.698069 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:02.698126 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:02.701624 (+ 3498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:02.702542 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:02.702549 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:02.702556 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:02.702746 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:02.703176 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:02.703180 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:02.703182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:02.703803 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:02.704045 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:02.704515 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 06:49:02.704926 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":349,"threads_started":1}
I20260811 06:49:02.705847 15876 raft_consensus.cc:348] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37dee8602ce42128852753d9139f40d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34353 } }
I20260811 06:49:02.706260 15876 raft_consensus.cc:374] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:02.706363 15876 raft_consensus.cc:729] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e37dee8602ce42128852753d9139f40d, State: Initialized, Role: FOLLOWER
I20260811 06:49:02.706935 15876 consensus_queue.cc:260] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37dee8602ce42128852753d9139f40d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34353 } }
I20260811 06:49:02.707173 15876 raft_consensus.cc:388] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:02.707463 15876 raft_consensus.cc:482] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:02.707690 15876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:02.710367 15876 raft_consensus.cc:504] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37dee8602ce42128852753d9139f40d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34353 } }
I20260811 06:49:02.710860 15876 leader_election.cc:302] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e37dee8602ce42128852753d9139f40d; no voters:
I20260811 06:49:02.711440 15876 leader_election.cc:288] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:02.711586 15885 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:02.712533 15885 raft_consensus.cc:686] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [term 1 LEADER]: Becoming Leader. State: Replica: e37dee8602ce42128852753d9139f40d, State: Running, Role: LEADER
I20260811 06:49:02.713124 15885 consensus_queue.cc:237] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37dee8602ce42128852753d9139f40d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34353 } }
I20260811 06:49:02.713600 15876 sys_catalog.cc:564] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:02.716070 15888 sys_catalog.cc:455] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e37dee8602ce42128852753d9139f40d. Latest consensus state: current_term: 1 leader_uuid: "e37dee8602ce42128852753d9139f40d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37dee8602ce42128852753d9139f40d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34353 } } }
I20260811 06:49:02.716565 15888 sys_catalog.cc:458] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:02.716377 15887 sys_catalog.cc:455] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e37dee8602ce42128852753d9139f40d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37dee8602ce42128852753d9139f40d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34353 } } }
I20260811 06:49:02.716706 15887 sys_catalog.cc:458] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:02.717792 15899 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:02.723096 15899 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:02.732213 15899 catalog_manager.cc:1347] Generated new cluster ID: 33b42fa1383941b98430f14fbf6cbfc8
I20260811 06:49:02.732357 15899 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:02.764956 15899 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:02.766441 15899 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:02.774461 15899 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d: Generated new TSK 0
I20260811 06:49:02.775533 15899 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:49:02.841192 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:34353
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:03.171730 15920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:03.172024 15920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:03.172173 15920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:03.179337 15920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:03.179456 15920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:03.179584 15920 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 06:49:03.179646 15920 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 06:49:03.179751 15920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:49:03.189492 15920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.62:34353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:03.190883 15920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:03.192242 15920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:03.206157 15931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:03.206089 15934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:03.206126 15932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:03.208027 15920 server_base.cc:1034] running on GCE node
I20260811 06:49:03.208670 15920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:03.209719 15920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:03.210922 15920 hybrid_clock.cc:648] HybridClock initialized: now 1786430943210865 us; error 52 us; skew 500 ppm
I20260811 06:49:03.211246 15920 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:03 dist-test-slave-7lbf krb5kdc[15719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430943, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:03.214365 15920 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:49:03.215904 15920 webserver.cc:460] Webserver started at http://127.12.145.1:46097/ using document root <none> and password file <none>
I20260811 06:49:03.216660 15920 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:03.216782 15920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:03.217190 15920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:03.220388 15920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "47a312485f81407a95a6fa8ded24a662"
format_stamp: "Formatted at 2026-08-11 06:49:03 on dist-test-slave-7lbf"
server_key: "45c93687fe06f657dc3c426ceb21fefa"
server_key_iv: "8f48f91c923e289f015186ccf70e55de"
server_key_version: "encryptionkey@0"
I20260811 06:49:03.221203 15920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "47a312485f81407a95a6fa8ded24a662"
format_stamp: "Formatted at 2026-08-11 06:49:03 on dist-test-slave-7lbf"
server_key: "45c93687fe06f657dc3c426ceb21fefa"
server_key_iv: "8f48f91c923e289f015186ccf70e55de"
server_key_version: "encryptionkey@0"
I20260811 06:49:03.226645 15920 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 06:49:03.230197 15948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:03.231719 15920 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:03.231935 15920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "47a312485f81407a95a6fa8ded24a662"
format_stamp: "Formatted at 2026-08-11 06:49:03 on dist-test-slave-7lbf"
server_key: "45c93687fe06f657dc3c426ceb21fefa"
server_key_iv: "8f48f91c923e289f015186ccf70e55de"
server_key_version: "encryptionkey@0"
I20260811 06:49:03.232143 15920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:03.252140 15920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:03.256183 15920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:03.256474 15920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:03.259436 15920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:03.259565 15920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:03.259688 15920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:03.259774 15920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 06:49:03 dist-test-slave-7lbf krb5kdc[15719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430943, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:03.283419 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:03.260113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:57519 (local address 127.12.145.62:34353)
0811 06:49:03.262680 (+ 2567us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:03.262686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:03.262710 (+ 24us) server_negotiation.cc:407] Connection header received
0811 06:49:03.264294 (+ 1584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:03.264300 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:03.264404 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:03.264509 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:03.266917 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.267824 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.270883 (+ 3059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.271693 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.271840 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:03.276305 (+ 4465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:03.276322 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:03.276327 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:03.276377 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:03.279884 (+ 3507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:03.280850 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:03.280856 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:03.280860 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:03.281036 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:03.281488 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:03.281494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:03.281497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:03.281910 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:03.282060 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:03.282811 (+ 751us) server_negotiation.cc:299] Negotiation successful
0811 06:49:03.283061 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2436,"thread_start_us":2318,"threads_started":1}
I20260811 06:49:03.284492 15966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:03.260830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:34353 (local address 127.12.145.1:57519)
0811 06:49:03.261893 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:03.261958 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:03.263989 (+ 2031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:03.264831 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:03.264844 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:03.265698 (+ 854us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:03.266706 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:03.266742 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.268017 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.268023 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:03.270636 (+ 2613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:03.270653 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.271929 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.271935 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:03.272169 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:03.272944 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:03.272974 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:03.276009 (+ 3035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:03.280034 (+ 4025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:03.280045 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:03.280060 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:03.280704 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:03.281156 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:03.281160 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:03.281163 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:03.281361 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:03.282051 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:03.282059 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:03.282433 (+ 374us) client_negotiation.cc:769] Sending connection context
0811 06:49:03.282692 (+ 259us) client_negotiation.cc:240] Negotiation successful
0811 06:49:03.283237 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"thread_start_us":406,"threads_started":1}
I20260811 06:49:03.305032 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:03.290023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:34765 (local address 127.12.145.62:34353)
0811 06:49:03.290214 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:03.290219 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:03.291043 (+ 824us) server_negotiation.cc:407] Connection header received
0811 06:49:03.291243 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:03.291248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:03.291311 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:03.291391 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:03.292810 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.293766 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.295700 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.296206 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.296335 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:03.299020 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:03.299027 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:03.299032 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:03.299074 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:03.302386 (+ 3312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:03.303054 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:03.303060 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:03.303064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:03.303203 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:03.303561 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:03.303566 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:03.303570 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:03.303857 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:03.303993 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:03.304412 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 06:49:03.304663 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 06:49:03.305145 16036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:03.290144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:34353 (local address 127.12.145.1:34765)
0811 06:49:03.290914 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:03.290940 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:03.291105 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:03.291446 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:03.291451 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:03.292138 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:03.292593 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:03.292612 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.293938 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.293942 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:03.295544 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:03.295561 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.296600 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.296608 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:03.296851 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:03.297583 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:03.297612 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:03.298790 (+ 1178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:03.302520 (+ 3730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:03.302525 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:03.302530 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:03.302927 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:03.303312 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:03.303317 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:03.303321 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:03.303455 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:03.303983 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:03.303988 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:03.304173 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 06:49:03.304299 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 06:49:03.304666 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":417,"threads_started":1}
I20260811 06:49:03.314229 15920 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:45709
I20260811 06:49:03.314302 16134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:45709 every 8 connection(s)
I20260811 06:49:03.315567 15920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:49:03.317674 16135 heartbeater.cc:347] Connected to a master server at 127.12.145.62:34353
I20260811 06:49:03.317911 16135 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:03.318620 16135 heartbeater.cc:511] Master 127.12.145.62:34353 requested a full tablet report, sending...
I20260811 06:49:03.320621 15798 ts_manager.cc:194] Registered new tserver with Master: 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709)
I20260811 06:49:03.322018 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 15920
I20260811 06:49:03.322240 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:49:03.322510 15798 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:57519
I20260811 06:49:03.323045 12868 external_mini_cluster.cc:1428] Setting key 6fe31cadd42cdc7df6166846c10bd4d0
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:49:03.369019 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:34353
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:03.702945 16145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:03.703258 16145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:03.703414 16145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:03.710801 16145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:03.710945 16145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:03.711078 16145 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 06:49:03.711146 16145 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 06:49:03.711251 16145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:49:03.721421 16145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.62:34353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:03.722826 16145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:03.724146 16145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:03.742357 16154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:03.742759 16156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:03.742800 16159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:03.743836 16145 server_base.cc:1034] running on GCE node
I20260811 06:49:03.744495 16145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:03.745543 16145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:03.746754 16145 hybrid_clock.cc:648] HybridClock initialized: now 1786430943746680 us; error 72 us; skew 500 ppm
I20260811 06:49:03.747090 16145 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:03 dist-test-slave-7lbf krb5kdc[15719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430943, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:03.750315 16145 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:49:03.751964 16145 webserver.cc:460] Webserver started at http://127.12.145.2:37181/ using document root <none> and password file <none>
I20260811 06:49:03.752681 16145 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:03.752801 16145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:03.753197 16145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:03.756254 16145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "6724f97ac9a040ddbdf430fcb24a4270"
format_stamp: "Formatted at 2026-08-11 06:49:03 on dist-test-slave-7lbf"
server_key: "8373520d23176eb9b75ae99da439690b"
server_key_iv: "f9aae8d158453c38a3e5187fefa86c06"
server_key_version: "encryptionkey@0"
I20260811 06:49:03.757026 16145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "6724f97ac9a040ddbdf430fcb24a4270"
format_stamp: "Formatted at 2026-08-11 06:49:03 on dist-test-slave-7lbf"
server_key: "8373520d23176eb9b75ae99da439690b"
server_key_iv: "f9aae8d158453c38a3e5187fefa86c06"
server_key_version: "encryptionkey@0"
I20260811 06:49:03.762537 16145 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 06:49:03.766175 16169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:03.767511 16145 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:03.767675 16145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "6724f97ac9a040ddbdf430fcb24a4270"
format_stamp: "Formatted at 2026-08-11 06:49:03 on dist-test-slave-7lbf"
server_key: "8373520d23176eb9b75ae99da439690b"
server_key_iv: "f9aae8d158453c38a3e5187fefa86c06"
server_key_version: "encryptionkey@0"
I20260811 06:49:03.767877 16145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:03.791019 16145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:03.795275 16145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:03.795552 16145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:03.798448 16145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:03.798578 16145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:03.798749 16145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:03.798893 16145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 06:49:03 dist-test-slave-7lbf krb5kdc[15719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430943, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:03.822484 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:03.799015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:32883 (local address 127.12.145.62:34353)
0811 06:49:03.799200 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:03.799207 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:03.800929 (+ 1722us) server_negotiation.cc:407] Connection header received
0811 06:49:03.803214 (+ 2285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:03.803221 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:03.803310 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:03.803424 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:03.805714 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.806865 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.809650 (+ 2785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.810341 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.810495 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:03.815394 (+ 4899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:03.815401 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:03.815404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:03.815445 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:03.818649 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:03.819483 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:03.819490 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:03.819495 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:03.819677 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:03.820267 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:03.820273 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:03.820277 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:03.820702 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:03.820878 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:03.821891 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0811 06:49:03.822127 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:49:03.823935 16182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:03.799718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:34353 (local address 127.12.145.2:32883)
0811 06:49:03.800707 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:03.800759 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:03.802865 (+ 2106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:03.803707 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:03.803716 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:03.804492 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:03.805457 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:03.805493 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.807071 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.807078 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:03.809451 (+ 2373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:03.809467 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.810722 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.810732 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:03.810983 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:03.811883 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:03.811934 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:03.815106 (+ 3172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:03.818814 (+ 3708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:03.818825 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:03.818845 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:03.819308 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:03.819837 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:03.819844 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:03.819847 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:03.820104 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:03.820855 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:03.820864 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:03.821357 (+ 493us) client_negotiation.cc:769] Sending connection context
0811 06:49:03.821768 (+ 411us) client_negotiation.cc:240] Negotiation successful
0811 06:49:03.822385 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":395,"threads_started":1}
I20260811 06:49:03.840577 16145 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:45535
I20260811 06:49:03.840668 16366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:45535 every 8 connection(s)
I20260811 06:49:03.842123 16145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:49:03.844614 16367 heartbeater.cc:347] Connected to a master server at 127.12.145.62:34353
I20260811 06:49:03.844892 16367 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:03.845630 16367 heartbeater.cc:511] Master 127.12.145.62:34353 requested a full tablet report, sending...
I20260811 06:49:03.846988 15798 ts_manager.cc:194] Registered new tserver with Master: 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535)
I20260811 06:49:03.847647 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:03.832098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:57001 (local address 127.12.145.62:34353)
0811 06:49:03.832262 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:03.832266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:03.833141 (+ 875us) server_negotiation.cc:407] Connection header received
0811 06:49:03.833335 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:03.833340 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:03.833431 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:03.833569 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:03.835089 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.836290 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.838505 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.839119 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.839257 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:03.841656 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:03.841664 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:03.841668 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:03.841711 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:03.844866 (+ 3155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:03.845546 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:03.845552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:03.845556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:03.845707 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:03.846098 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:03.846103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:03.846107 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:03.846535 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:03.846663 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:03.847079 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 06:49:03.847282 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 06:49:03.847704 16318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:03.832183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:34353 (local address 127.12.145.2:57001)
0811 06:49:03.833005 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:03.833027 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:03.833195 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:03.833614 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:03.833620 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:03.834311 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:03.834900 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:03.834922 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.836463 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.836469 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:03.838348 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:03.838369 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:03.839383 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:03.839392 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:03.839579 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:03.840405 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:03.840438 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:03.841429 (+ 991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:03.844994 (+ 3565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:03.845000 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:03.845005 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:03.845402 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:03.845848 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:03.845853 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:03.845857 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:03.845995 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:03.846659 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:03.846663 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:03.846834 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 06:49:03.846958 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 06:49:03.847285 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":388,"threads_started":1}
I20260811 06:49:03.847888 15798 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:32883
I20260811 06:49:03.850284 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 16145
I20260811 06:49:03.850487 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:49:03.850950 12868 external_mini_cluster.cc:1428] Setting key a9597827093d44939d70c3b78e134321
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:49:03.896072 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:34353
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:04.228124 16375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:04.228421 16375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:04.228559 16375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:04.235913 16375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:04.236044 16375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:04.236178 16375 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 06:49:04.236239 16375 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 06:49:04.236322 16375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:49:04.246317 16375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.62:34353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:04.247655 16375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:04.248982 16375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:04.262027 16383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:04.261940 16384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:04.261986 16386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:04.262995 16375 server_base.cc:1034] running on GCE node
I20260811 06:49:04.263589 16375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:04.264549 16375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:04.265740 16375 hybrid_clock.cc:648] HybridClock initialized: now 1786430944265695 us; error 37 us; skew 500 ppm
I20260811 06:49:04.266050 16375 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:04 dist-test-slave-7lbf krb5kdc[15719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430944, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:04.269133 16375 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:49:04.270844 16375 webserver.cc:460] Webserver started at http://127.12.145.3:43385/ using document root <none> and password file <none>
I20260811 06:49:04.271584 16375 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:04.271700 16375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:04.272033 16375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:04.275141 16375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "01ecf7a031334d24b9591846dcc17aad"
format_stamp: "Formatted at 2026-08-11 06:49:04 on dist-test-slave-7lbf"
server_key: "c316fb95f198a87b26a427543cc8babd"
server_key_iv: "b93f5dfad2c5045afd7f62508749d599"
server_key_version: "encryptionkey@0"
I20260811 06:49:04.275955 16375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "01ecf7a031334d24b9591846dcc17aad"
format_stamp: "Formatted at 2026-08-11 06:49:04 on dist-test-slave-7lbf"
server_key: "c316fb95f198a87b26a427543cc8babd"
server_key_iv: "b93f5dfad2c5045afd7f62508749d599"
server_key_version: "encryptionkey@0"
I20260811 06:49:04.281301 16375 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260811 06:49:04.284955 16400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:04.286362 16375 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:49:04.286514 16375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "01ecf7a031334d24b9591846dcc17aad"
format_stamp: "Formatted at 2026-08-11 06:49:04 on dist-test-slave-7lbf"
server_key: "c316fb95f198a87b26a427543cc8babd"
server_key_iv: "b93f5dfad2c5045afd7f62508749d599"
server_key_version: "encryptionkey@0"
I20260811 06:49:04.286708 16375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:04.299118 16375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:04.303514 16375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:04.303805 16375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:04.306550 16375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:04.306658 16375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:04.306775 16375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:04.306878 16375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 06:49:04 dist-test-slave-7lbf krb5kdc[15719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430944, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:04.325917 16135 heartbeater.cc:503] Master 127.12.145.62:34353 was elected leader, sending a full tablet report...
I20260811 06:49:04.334586 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.307042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:60911 (local address 127.12.145.62:34353)
0811 06:49:04.307263 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:04.307270 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:04.308630 (+ 1360us) server_negotiation.cc:407] Connection header received
0811 06:49:04.311436 (+ 2806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:04.311444 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:04.311546 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:04.311683 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:04.314029 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.315418 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.317901 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.318734 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.318894 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.324112 (+ 5218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:04.324121 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:04.324126 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:04.324182 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:04.328778 (+ 4596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:04.329930 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:04.329938 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:04.329942 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:04.330141 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:04.330720 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:04.330726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:04.330730 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:04.331150 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:04.331353 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:04.333828 (+ 2475us) server_negotiation.cc:299] Negotiation successful
0811 06:49:04.334117 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 06:49:04.334874 16411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.307594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:34353 (local address 127.12.145.3:60911)
0811 06:49:04.308426 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:04.308492 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:04.311079 (+ 2587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:04.311975 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:04.311988 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:04.312877 (+ 889us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:04.313797 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.313848 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.315634 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.315640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.317740 (+ 2100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.317756 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.318997 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.319006 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.319341 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.320077 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:04.320109 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:04.323792 (+ 3683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:04.328950 (+ 5158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:04.328965 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:04.328995 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:04.329767 (+ 772us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:04.330266 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:04.330270 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:04.330272 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:04.330557 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:04.331317 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:04.331329 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:04.331922 (+ 593us) client_negotiation.cc:769] Sending connection context
0811 06:49:04.332335 (+ 413us) client_negotiation.cc:240] Negotiation successful
0811 06:49:04.333024 (+ 689us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":322,"threads_started":1}
I20260811 06:49:04.360128 16536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.342870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:34353 (local address 127.12.145.3:48369)
0811 06:49:04.345058 (+ 2188us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:04.345076 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:04.345317 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:04.345823 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:04.345826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:04.346255 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:04.346563 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.346573 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.347903 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.347908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.349156 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.349171 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.350239 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.350248 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.350573 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.351495 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:04.351519 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:04.352579 (+ 1060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:04.356708 (+ 4129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:04.356713 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:04.356718 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:04.357347 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:04.357814 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:04.357818 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:04.357822 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:04.358012 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:04.358814 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:04.358820 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:04.359052 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 06:49:04.359208 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 06:49:04.359590 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2021,"thread_start_us":1806,"threads_started":1}
I20260811 06:49:04.361133 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.342800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:48369 (local address 127.12.145.62:34353)
0811 06:49:04.342992 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:04.342997 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:04.345174 (+ 2177us) server_negotiation.cc:407] Connection header received
0811 06:49:04.345561 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:04.345568 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:04.345661 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:04.345771 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:04.346698 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.347754 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.349309 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.349981 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.350125 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.352859 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:04.352866 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:04.352872 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:04.352916 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:04.356560 (+ 3644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:04.357466 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:04.357471 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:04.357475 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:04.357665 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:04.358182 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:04.358188 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:04.358192 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:04.358585 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:04.358735 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:04.360485 (+ 1750us) server_negotiation.cc:299] Negotiation successful
0811 06:49:04.360743 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 06:49:04.374303 16375 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:33327
I20260811 06:49:04.374377 16583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:33327 every 8 connection(s)
I20260811 06:49:04.375602 16375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:49:04.377830 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 16375
I20260811 06:49:04.378010 16585 heartbeater.cc:347] Connected to a master server at 127.12.145.62:34353
I20260811 06:49:04.378073 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:49:04.378255 16585 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:04.378635 12868 external_mini_cluster.cc:1428] Setting key e93cd1bfdbb282510c8e0d7e16e29097
I20260811 06:49:04.379132 16585 heartbeater.cc:511] Master 127.12.145.62:34353 requested a full tablet report, sending...
I20260811 06:49:04.380592 15797 ts_manager.cc:194] Registered new tserver with Master: 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327)
I20260811 06:49:04.381572 15797 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:60911
I20260811 06:49:04.386137 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 06:49:04 dist-test-slave-7lbf krb5kdc[15719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 06:49:04 dist-test-slave-7lbf krb5kdc[15719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:04.447083 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.432122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37902 (local address 127.12.145.62:34353)
0811 06:49:04.432347 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:04.432355 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:04.432625 (+ 270us) server_negotiation.cc:407] Connection header received
0811 06:49:04.432811 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:04.432815 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:04.432888 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:04.432978 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:04.434468 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.435313 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.437198 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.437750 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.437895 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.441904 (+ 4009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:04.441909 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:04.441912 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:04.441952 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:04.444449 (+ 2497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:04.445087 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:04.445093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:04.445095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:04.445231 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:04.445632 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:04.445636 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:04.445640 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:04.445934 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:04.446171 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:04.446494 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 06:49:04.446725 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 06:49:04.451829 15797 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:49:04.462767 15797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:49:04.491652 16606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.476889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37630 (local address 127.12.145.1:45709)
0811 06:49:04.483230 (+ 6341us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:04.483239 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:04.483270 (+ 31us) server_negotiation.cc:407] Connection header received
0811 06:49:04.483384 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:04.483392 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:04.483657 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:04.483853 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:04.484567 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.486248 (+ 1681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.489117 (+ 2869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.490434 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.490582 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.490803 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:04.491154 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 06:49:04.491322 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6187,"thread_start_us":6033,"threads_started":1}
I20260811 06:49:04.492192 16605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.476639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45709 (local address 127.0.0.1:37630)
0811 06:49:04.481953 (+ 5314us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:04.482000 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:04.482211 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:04.483864 (+ 1653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:04.483872 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:04.483900 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:04.484321 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.484336 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.486416 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.486422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.488925 (+ 2503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.488939 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.490674 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.490681 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.490886 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.490941 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 06:49:04.491085 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 06:49:04.491384 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5004,"mutex_wait_us":5,"thread_start_us":6483,"threads_started":1}
I20260811 06:49:04.492803 16607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.477344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46896 (local address 127.12.145.3:33327)
0811 06:49:04.482953 (+ 5609us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:04.482962 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:04.483509 (+ 547us) server_negotiation.cc:407] Connection header received
0811 06:49:04.483808 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:04.483817 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:04.484061 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:04.484259 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:04.485302 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.487107 (+ 1805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.489681 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.491117 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.491244 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.491457 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:04.492177 (+ 720us) server_negotiation.cc:299] Negotiation successful
0811 06:49:04.492474 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5439,"thread_start_us":5248,"threads_started":1}
I20260811 06:49:04.493499 16603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.476710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:33327 (local address 127.0.0.1:46896)
0811 06:49:04.483385 (+ 6675us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:04.483402 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:04.483614 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:04.484586 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:04.484592 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:04.484621 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:04.485069 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.485081 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.487306 (+ 2225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.487312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.489474 (+ 2162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.489488 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.491603 (+ 2115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.491609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.491963 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.492000 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 06:49:04.493021 (+ 1021us) client_negotiation.cc:240] Negotiation successful
0811 06:49:04.493164 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6559,"thread_start_us":404,"threads_started":1}
I20260811 06:49:04.496357 16609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.483484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:45535 (local address 127.0.0.1:43600)
0811 06:49:04.488832 (+ 5348us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:04.488850 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:04.488972 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:04.489703 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:04.489708 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:04.489735 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:04.490074 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.490086 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.492133 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.492138 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.494257 (+ 2119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.494272 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.495638 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.495645 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.495821 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.495854 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 06:49:04.495918 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 06:49:04.496034 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5226,"thread_start_us":5087,"threads_started":1}
I20260811 06:49:04.496438 16037 tablet_service.cc:1467] Processing CreateTablet for tablet 5616a2dd06994a5188fbf250cdd150ed (DEFAULT_TABLE table=test-table [id=3540ca40b3784408862a50e911172d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:04.497202 16608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.483725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43600 (local address 127.12.145.2:45535)
0811 06:49:04.488401 (+ 4676us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:04.488409 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:04.489107 (+ 698us) server_negotiation.cc:407] Connection header received
0811 06:49:04.489206 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:04.489214 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:04.489462 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:04.490281 (+ 819us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:04.490489 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.491964 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.494483 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.495409 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.496573 (+ 1164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.496783 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:04.496851 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 06:49:04.496969 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4512,"thread_start_us":4392,"threads_started":1}
I20260811 06:49:04.497165 16468 tablet_service.cc:1467] Processing CreateTablet for tablet 5616a2dd06994a5188fbf250cdd150ed (DEFAULT_TABLE table=test-table [id=3540ca40b3784408862a50e911172d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:04.498071 16037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5616a2dd06994a5188fbf250cdd150ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:04.498610 16468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5616a2dd06994a5188fbf250cdd150ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:04.499977 16246 tablet_service.cc:1467] Processing CreateTablet for tablet 5616a2dd06994a5188fbf250cdd150ed (DEFAULT_TABLE table=test-table [id=3540ca40b3784408862a50e911172d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:04.501204 16246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5616a2dd06994a5188fbf250cdd150ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:04.512373 16610 tablet_bootstrap.cc:492] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: Bootstrap starting.
I20260811 06:49:04.514277 16614 tablet_bootstrap.cc:492] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: Bootstrap starting.
I20260811 06:49:04.516484 16610 tablet_bootstrap.cc:654] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:04.517352 16613 tablet_bootstrap.cc:492] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: Bootstrap starting.
I20260811 06:49:04.518049 16614 tablet_bootstrap.cc:654] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:04.518241 16610 log.cc:824] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:04.519415 16614 log.cc:824] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:04.521029 16613 tablet_bootstrap.cc:654] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:04.521786 16610 tablet_bootstrap.cc:492] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: No bootstrap required, opened a new log
I20260811 06:49:04.522081 16610 ts_tablet_manager.cc:1397] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 06:49:04.522095 16613 log.cc:824] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:04.522471 16614 tablet_bootstrap.cc:492] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: No bootstrap required, opened a new log
I20260811 06:49:04.522733 16614 ts_tablet_manager.cc:1397] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 06:49:04.524485 16613 tablet_bootstrap.cc:492] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: No bootstrap required, opened a new log
I20260811 06:49:04.524713 16613 ts_tablet_manager.cc:1397] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260811 06:49:04.532547 16613 raft_consensus.cc:348] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } }
I20260811 06:49:04.533020 16613 raft_consensus.cc:374] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:04.533131 16613 raft_consensus.cc:729] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a312485f81407a95a6fa8ded24a662, State: Initialized, Role: FOLLOWER
I20260811 06:49:04.532816 16610 raft_consensus.cc:348] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } }
I20260811 06:49:04.533018 16614 raft_consensus.cc:348] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } }
I20260811 06:49:04.533306 16610 raft_consensus.cc:374] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:04.533411 16614 raft_consensus.cc:374] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:04.533422 16610 raft_consensus.cc:729] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6724f97ac9a040ddbdf430fcb24a4270, State: Initialized, Role: FOLLOWER
I20260811 06:49:04.533506 16614 raft_consensus.cc:729] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01ecf7a031334d24b9591846dcc17aad, State: Initialized, Role: FOLLOWER
I20260811 06:49:04.533936 16613 consensus_queue.cc:260] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } }
I20260811 06:49:04.534063 16610 consensus_queue.cc:260] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } }
I20260811 06:49:04.534191 16614 consensus_queue.cc:260] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } }
I20260811 06:49:04.535286 16367 heartbeater.cc:503] Master 127.12.145.62:34353 was elected leader, sending a full tablet report...
I20260811 06:49:04.538080 16610 ts_tablet_manager.cc:1428] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: Time spent starting tablet: real 0.016s user 0.010s sys 0.004s
I20260811 06:49:04.538867 16585 heartbeater.cc:503] Master 127.12.145.62:34353 was elected leader, sending a full tablet report...
I20260811 06:49:04.539811 16614 ts_tablet_manager.cc:1428] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260811 06:49:04.541330 16613 ts_tablet_manager.cc:1428] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: Time spent starting tablet: real 0.017s user 0.012s sys 0.005s
W20260811 06:49:04.568084 16142 tablet.cc:2369] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:49:04.594519 16369 tablet.cc:2369] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:49:04.627341 16586 tablet.cc:2369] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:49:04.655745 16625 raft_consensus.cc:482] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:04.656065 16625 raft_consensus.cc:504] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } }
I20260811 06:49:04.657871 16625 leader_election.cc:288] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709), 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535)
I20260811 06:49:04.663722 16606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.658190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:44281 (local address 127.12.145.1:45709)
0811 06:49:04.658413 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:04.658420 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:04.658481 (+ 61us) server_negotiation.cc:407] Connection header received
0811 06:49:04.658695 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:04.658701 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:04.658792 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:04.658906 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:04.659510 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.660228 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.662102 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.662873 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.663027 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.663102 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:04.663358 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 06:49:04.663486 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 06:49:04.663759 16411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.658221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45709 (local address 127.12.145.3:44281)
0811 06:49:04.658407 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:04.658425 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:04.658544 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:04.659175 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:04.659179 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:04.659202 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:04.659376 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.659384 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.660348 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.660352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.661940 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.661953 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.663022 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.663028 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.663211 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.663235 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 06:49:04.663318 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 06:49:04.663449 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":42}
I20260811 06:49:04.664500 16608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.658899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:56351 (local address 127.12.145.2:45535)
0811 06:49:04.659125 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:04.659130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:04.659372 (+ 242us) server_negotiation.cc:407] Connection header received
0811 06:49:04.659545 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:04.659549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:04.659610 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:04.659682 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:04.660278 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.661019 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.662763 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.663544 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.663692 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.663762 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:04.664155 (+ 393us) server_negotiation.cc:299] Negotiation successful
0811 06:49:04.664292 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 06:49:04.664532 16627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.658617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:45535 (local address 127.12.145.3:56351)
0811 06:49:04.659274 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:04.659288 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:04.659415 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:04.659712 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:04.659716 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:04.659739 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:04.660103 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.660116 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.661157 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.661162 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.662610 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.662623 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.663754 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.663759 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.663925 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.663957 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 06:49:04.664096 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 06:49:04.664207 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"mutex_wait_us":2,"thread_start_us":342,"threads_started":1}
I20260811 06:49:04.664896 16063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5616a2dd06994a5188fbf250cdd150ed" candidate_uuid: "01ecf7a031334d24b9591846dcc17aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a312485f81407a95a6fa8ded24a662" is_pre_election: true
I20260811 06:49:04.665391 16063 raft_consensus.cc:2454] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01ecf7a031334d24b9591846dcc17aad in term 0.
I20260811 06:49:04.665485 16281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5616a2dd06994a5188fbf250cdd150ed" candidate_uuid: "01ecf7a031334d24b9591846dcc17aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6724f97ac9a040ddbdf430fcb24a4270" is_pre_election: true
I20260811 06:49:04.665977 16281 raft_consensus.cc:2454] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01ecf7a031334d24b9591846dcc17aad in term 0.
I20260811 06:49:04.666067 16405 leader_election.cc:302] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01ecf7a031334d24b9591846dcc17aad, 47a312485f81407a95a6fa8ded24a662; no voters:
I20260811 06:49:04.666441 16625 raft_consensus.cc:2781] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:49:04.666605 16625 raft_consensus.cc:482] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:49:04.666723 16625 raft_consensus.cc:3037] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:04.668905 16625 raft_consensus.cc:504] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } }
I20260811 06:49:04.669492 16625 leader_election.cc:288] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [CANDIDATE]: Term 1 election: Requested vote from peers 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709), 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535)
I20260811 06:49:04.669988 16063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5616a2dd06994a5188fbf250cdd150ed" candidate_uuid: "01ecf7a031334d24b9591846dcc17aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a312485f81407a95a6fa8ded24a662"
I20260811 06:49:04.670089 16281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5616a2dd06994a5188fbf250cdd150ed" candidate_uuid: "01ecf7a031334d24b9591846dcc17aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6724f97ac9a040ddbdf430fcb24a4270"
I20260811 06:49:04.670223 16063 raft_consensus.cc:3037] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:04.670300 16281 raft_consensus.cc:3037] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:04.672876 16281 raft_consensus.cc:2454] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01ecf7a031334d24b9591846dcc17aad in term 1.
I20260811 06:49:04.673246 16405 leader_election.cc:302] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01ecf7a031334d24b9591846dcc17aad, 6724f97ac9a040ddbdf430fcb24a4270; no voters:
I20260811 06:49:04.673381 16063 raft_consensus.cc:2454] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01ecf7a031334d24b9591846dcc17aad in term 1.
I20260811 06:49:04.673535 16625 raft_consensus.cc:2781] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:04.678817 16625 raft_consensus.cc:686] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 1 LEADER]: Becoming Leader. State: Replica: 01ecf7a031334d24b9591846dcc17aad, State: Running, Role: LEADER
I20260811 06:49:04.679405 16625 consensus_queue.cc:237] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } }
I20260811 06:49:04.683983 15797 catalog_manager.cc:5495] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad reported cstate change: term changed from 0 to 1, leader changed from <none> to 01ecf7a031334d24b9591846dcc17aad (127.12.145.3). New cstate: current_term: 1 leader_uuid: "01ecf7a031334d24b9591846dcc17aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } health_report { overall_health: UNKNOWN } } }
Aug 11 06:49:04 dist-test-slave-7lbf krb5kdc[15719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430942, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:04.773320 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.760266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37918 (local address 127.12.145.62:34353)
0811 06:49:04.760530 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:04.760537 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:04.761080 (+ 543us) server_negotiation.cc:407] Connection header received
0811 06:49:04.761253 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:04.761259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:04.761341 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:04.761429 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:04.762648 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.763375 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.764606 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.765041 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.765151 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.768391 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:04.768395 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:04.768399 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:04.768427 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:04.770702 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:04.771356 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:04.771362 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:04.771366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:04.771497 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:04.771856 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:04.771861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:04.771864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:04.772156 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:04.772288 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:04.772705 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 06:49:04.773011 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":99,"server-negotiator.queue_time_us":122}
I20260811 06:49:04.773344 16641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:04.760303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:34353 (local address 127.0.0.1:37918)
0811 06:49:04.760959 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:04.760976 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:04.761137 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:04.761478 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:04.761482 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:04.762211 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:04.762491 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.762501 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.763507 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.763511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.764460 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:04.764473 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:04.765230 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:04.765236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:04.765400 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:04.766029 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:04.766047 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:04.768218 (+ 2171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:04.770827 (+ 2609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:04.770840 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:04.770848 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:04.771246 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:04.771597 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:04.771602 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:04.771606 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:04.771749 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:04.772279 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:04.772287 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:04.772449 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 06:49:04.772593 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 06:49:04.772863 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":370,"threads_started":1}
I20260811 06:49:04.778335 15797 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:37918:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 06:49:04.779317 15797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:49:04.785838 16037 tablet_service.cc:1467] Processing CreateTablet for tablet 32abafb8f5e642388a2f12258225cc1b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=700666d6b56f416c8c554397c0cd97b1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 06:49:04.786041 16468 tablet_service.cc:1467] Processing CreateTablet for tablet 32abafb8f5e642388a2f12258225cc1b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=700666d6b56f416c8c554397c0cd97b1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 06:49:04.786051 16246 tablet_service.cc:1467] Processing CreateTablet for tablet 32abafb8f5e642388a2f12258225cc1b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=700666d6b56f416c8c554397c0cd97b1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 06:49:04.786924 16246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32abafb8f5e642388a2f12258225cc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:04.786923 16468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32abafb8f5e642388a2f12258225cc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:04.786945 16037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32abafb8f5e642388a2f12258225cc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:04.794278 16614 tablet_bootstrap.cc:492] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: Bootstrap starting.
I20260811 06:49:04.794278 16610 tablet_bootstrap.cc:492] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: Bootstrap starting.
I20260811 06:49:04.795519 16613 tablet_bootstrap.cc:492] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: Bootstrap starting.
I20260811 06:49:04.795972 16614 tablet_bootstrap.cc:654] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:04.795972 16610 tablet_bootstrap.cc:654] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:04.797160 16613 tablet_bootstrap.cc:654] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:04.799446 16614 tablet_bootstrap.cc:492] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: No bootstrap required, opened a new log
I20260811 06:49:04.799604 16614 ts_tablet_manager.cc:1397] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260811 06:49:04.799624 16613 tablet_bootstrap.cc:492] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: No bootstrap required, opened a new log
I20260811 06:49:04.799762 16613 ts_tablet_manager.cc:1397] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20260811 06:49:04.800170 16610 tablet_bootstrap.cc:492] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: No bootstrap required, opened a new log
I20260811 06:49:04.800316 16610 ts_tablet_manager.cc:1397] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260811 06:49:04.800326 16614 raft_consensus.cc:348] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:04.800565 16614 raft_consensus.cc:374] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:04.800550 16613 raft_consensus.cc:348] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:04.800688 16614 raft_consensus.cc:729] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01ecf7a031334d24b9591846dcc17aad, State: Initialized, Role: FOLLOWER
I20260811 06:49:04.800774 16613 raft_consensus.cc:374] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:04.800864 16613 raft_consensus.cc:729] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a312485f81407a95a6fa8ded24a662, State: Initialized, Role: FOLLOWER
I20260811 06:49:04.800918 16614 consensus_queue.cc:260] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:04.801072 16613 consensus_queue.cc:260] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:04.801055 16610 raft_consensus.cc:348] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:04.801281 16610 raft_consensus.cc:374] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:04.801373 16610 raft_consensus.cc:729] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6724f97ac9a040ddbdf430fcb24a4270, State: Initialized, Role: FOLLOWER
I20260811 06:49:04.801566 16621 tablet_replica.cc:439] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } }
I20260811 06:49:04.801680 16610 consensus_queue.cc:260] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:04.801941 16621 tablet_replica.cc:442] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:04.802246 16622 tablet_replica.cc:439] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } }
I20260811 06:49:04.802577 16622 tablet_replica.cc:442] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:04.802551 16625 tablet_replica.cc:439] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } }
I20260811 06:49:04.802819 16625 tablet_replica.cc:442] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:04.803038 16610 ts_tablet_manager.cc:1428] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:49:04.803386 16613 ts_tablet_manager.cc:1428] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:49:04.801484 16614 ts_tablet_manager.cc:1428] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 06:49:05.145936 16625 consensus_queue.cc:1035] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:05.153692 16629 consensus_queue.cc:1035] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:05.166476 16621 raft_consensus.cc:482] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:05.166683 16621 raft_consensus.cc:504] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.168103 16621 leader_election.cc:288] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535), 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327)
I20260811 06:49:05.186677 16660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.168507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:50781 (local address 127.12.145.3:33327)
0811 06:49:05.180591 (+ 12084us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.180599 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.181390 (+ 791us) server_negotiation.cc:407] Connection header received
0811 06:49:05.181599 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.181603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.181668 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.181753 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:05.182311 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.183028 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.184835 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.185670 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.185823 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.185903 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.186227 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.186371 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11915,"thread_start_us":11785,"threads_started":1}
I20260811 06:49:05.186769 16658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.168378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:33327 (local address 127.12.145.1:50781)
0811 06:49:05.181277 (+ 12899us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:05.181293 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:05.181432 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:05.181784 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:05.181788 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:05.181812 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:05.182144 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.182155 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.183167 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.183171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.184671 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.184685 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.185824 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.185830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.186029 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.186085 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 06:49:05.186188 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 06:49:05.186324 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12778,"mutex_wait_us":80,"spinlock_wait_cycles":2944,"thread_start_us":12203,"threads_started":1}
I20260811 06:49:05.186847 16657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.168378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:45535 (local address 127.12.145.1:43393)
0811 06:49:05.180833 (+ 12455us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:05.180859 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:05.181076 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:05.181863 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:05.181868 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:05.181912 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:05.182299 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.182309 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.183423 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.183427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.184805 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.184818 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.185964 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.185971 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.186141 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.186164 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 06:49:05.186243 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 06:49:05.186410 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12315,"mutex_wait_us":2,"thread_start_us":12625,"threads_started":1}
I20260811 06:49:05.187176 16663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.168509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:43393 (local address 127.12.145.2:45535)
0811 06:49:05.181585 (+ 13076us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.181590 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.181609 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:49:05.181669 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.181673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.181736 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.181820 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:05.182453 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.183280 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.184961 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.185731 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.185878 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.185996 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.186283 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.186417 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12948,"thread_start_us":12850,"threads_started":1}
I20260811 06:49:05.187675 16500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32abafb8f5e642388a2f12258225cc1b" candidate_uuid: "47a312485f81407a95a6fa8ded24a662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01ecf7a031334d24b9591846dcc17aad" is_pre_election: true
I20260811 06:49:05.187810 16281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32abafb8f5e642388a2f12258225cc1b" candidate_uuid: "47a312485f81407a95a6fa8ded24a662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6724f97ac9a040ddbdf430fcb24a4270" is_pre_election: true
I20260811 06:49:05.188086 16281 raft_consensus.cc:2454] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47a312485f81407a95a6fa8ded24a662 in term 0.
I20260811 06:49:05.188097 16500 raft_consensus.cc:2454] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47a312485f81407a95a6fa8ded24a662 in term 0.
I20260811 06:49:05.188560 15953 leader_election.cc:302] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a312485f81407a95a6fa8ded24a662, 6724f97ac9a040ddbdf430fcb24a4270; no voters:
I20260811 06:49:05.188956 16621 raft_consensus.cc:2781] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:49:05.189085 16621 raft_consensus.cc:482] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:49:05.189189 16621 raft_consensus.cc:3037] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:05.191740 16621 raft_consensus.cc:504] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.192286 16621 leader_election.cc:288] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [CANDIDATE]: Term 1 election: Requested vote from peers 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535), 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327)
I20260811 06:49:05.192764 16281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32abafb8f5e642388a2f12258225cc1b" candidate_uuid: "47a312485f81407a95a6fa8ded24a662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6724f97ac9a040ddbdf430fcb24a4270"
I20260811 06:49:05.192955 16281 raft_consensus.cc:3037] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:05.195053 16281 raft_consensus.cc:2454] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a312485f81407a95a6fa8ded24a662 in term 1.
I20260811 06:49:05.195394 16500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32abafb8f5e642388a2f12258225cc1b" candidate_uuid: "47a312485f81407a95a6fa8ded24a662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01ecf7a031334d24b9591846dcc17aad"
I20260811 06:49:05.195442 15953 leader_election.cc:302] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a312485f81407a95a6fa8ded24a662, 6724f97ac9a040ddbdf430fcb24a4270; no voters:
I20260811 06:49:05.195580 16500 raft_consensus.cc:3037] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:05.195724 16621 raft_consensus.cc:2781] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:05.196184 16621 raft_consensus.cc:686] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [term 1 LEADER]: Becoming Leader. State: Replica: 47a312485f81407a95a6fa8ded24a662, State: Running, Role: LEADER
I20260811 06:49:05.196808 16621 consensus_queue.cc:237] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.197768 16500 raft_consensus.cc:2454] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a312485f81407a95a6fa8ded24a662 in term 1.
I20260811 06:49:05.198791 16664 tablet_replica.cc:439] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: TxnStatusTablet state changed. Reason: New leader 47a312485f81407a95a6fa8ded24a662. Latest consensus state: current_term: 1 leader_uuid: "47a312485f81407a95a6fa8ded24a662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } }
I20260811 06:49:05.199129 16664 tablet_replica.cc:442] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: This TxnStatusTablet replica's current role is: LEADER
I20260811 06:49:05.199882 16667 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 06:49:05.200174 16667 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 06:49:05.200699 15798 catalog_manager.cc:5495] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47a312485f81407a95a6fa8ded24a662 (127.12.145.1). New cstate: current_term: 1 leader_uuid: "47a312485f81407a95a6fa8ded24a662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } health_report { overall_health: UNKNOWN } } }
I20260811 06:49:05.261471 16672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.254520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37642 (local address 127.12.145.1:45709)
0811 06:49:05.255228 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.255233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.255261 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:49:05.255358 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.255362 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.255448 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.255596 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:05.256043 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.256963 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.258982 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.259492 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.259600 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.260214 (+ 614us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.260836 (+ 622us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.260958 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.261095 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.261164 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":384,"threads_started":1}
I20260811 06:49:05.261587 16641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.254431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45709 (local address 127.0.0.1:37642)
0811 06:49:05.254710 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:05.254733 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:05.254878 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:05.255639 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:05.255644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:05.255659 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:49:05.255873 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.255883 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.257100 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.257105 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.258807 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.258825 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.259651 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.259657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.259864 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.259943 (+ 79us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.260947 (+ 1004us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.260969 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 06:49:05.261052 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 06:49:05.261221 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 06:49:05.268554 16281 raft_consensus.cc:1261] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Refusing update from remote peer 47a312485f81407a95a6fa8ded24a662: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:05.268647 16500 raft_consensus.cc:1261] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Refusing update from remote peer 47a312485f81407a95a6fa8ded24a662: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:05.269342 16664 consensus_queue.cc:1035] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:05.269763 16621 consensus_queue.cc:1035] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:05.278424 16622 tablet_replica.cc:439] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: TxnStatusTablet state changed. Reason: New leader 47a312485f81407a95a6fa8ded24a662. Latest consensus state: current_term: 1 leader_uuid: "47a312485f81407a95a6fa8ded24a662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } }
I20260811 06:49:05.278764 16622 tablet_replica.cc:442] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:05.281180 16653 mvcc.cc:205] Tried to move back new op lower bound from 7317221151811809280 to 7317221151529885696. Current Snapshot: MvccSnapshot[applied={T|T < 7317221151811809280}]
I20260811 06:49:05.281973 16621 tablet_replica.cc:439] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "47a312485f81407a95a6fa8ded24a662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } }
I20260811 06:49:05.282287 16621 tablet_replica.cc:442] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: This TxnStatusTablet replica's current role is: LEADER
I20260811 06:49:05.282390 16629 tablet_replica.cc:439] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: TxnStatusTablet state changed. Reason: New leader 47a312485f81407a95a6fa8ded24a662. Latest consensus state: current_term: 1 leader_uuid: "47a312485f81407a95a6fa8ded24a662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } }
I20260811 06:49:05.282668 16629 tablet_replica.cc:442] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:05.284375 16664 tablet_replica.cc:439] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "47a312485f81407a95a6fa8ded24a662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } }
I20260811 06:49:05.284647 16664 tablet_replica.cc:442] T 32abafb8f5e642388a2f12258225cc1b P 47a312485f81407a95a6fa8ded24a662: This TxnStatusTablet replica's current role is: LEADER
I20260811 06:49:05.288789 16622 tablet_replica.cc:439] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "47a312485f81407a95a6fa8ded24a662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } }
I20260811 06:49:05.289041 16622 tablet_replica.cc:442] T 32abafb8f5e642388a2f12258225cc1b P 6724f97ac9a040ddbdf430fcb24a4270: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:05.298177 16629 tablet_replica.cc:439] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "47a312485f81407a95a6fa8ded24a662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } } }
I20260811 06:49:05.298491 16629 tablet_replica.cc:442] T 32abafb8f5e642388a2f12258225cc1b P 01ecf7a031334d24b9591846dcc17aad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:49:05.310554 16660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.299958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46900 (local address 127.12.145.3:33327)
0811 06:49:05.300137 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.300143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.304568 (+ 4425us) server_negotiation.cc:407] Connection header received
0811 06:49:05.304766 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.304772 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.304890 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.305059 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:05.305449 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.306607 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.307979 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.308679 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.308818 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.309190 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.309963 (+ 773us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.310110 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.310158 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.310248 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 06:49:05.329334 16672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.322250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:56065 (local address 127.12.145.1:45709)
0811 06:49:05.322432 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.322440 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.322959 (+ 519us) server_negotiation.cc:407] Connection header received
0811 06:49:05.323150 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.323156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.323251 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.323351 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:05.323866 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.325078 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.327097 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.327821 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.327950 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.328504 (+ 554us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.328659 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.328751 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.328960 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.329055 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 06:49:05.329591 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.322207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45709 (local address 127.12.145.3:56065)
0811 06:49:05.322846 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:05.322865 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:05.323018 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:05.323375 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:05.323379 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:05.323391 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:49:05.323692 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.323706 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.325255 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.325260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.326931 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.326955 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.327992 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.327999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.328176 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.328251 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.328810 (+ 559us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.328833 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 06:49:05.328918 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 06:49:05.329075 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":325,"threads_started":1}
I20260811 06:49:05.374074 16660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.367341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:57559 (local address 127.12.145.3:33327)
0811 06:49:05.367539 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.367546 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.367776 (+ 230us) server_negotiation.cc:407] Connection header received
0811 06:49:05.367937 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.367943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.368055 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.368146 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:05.368876 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.370041 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.371609 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.372286 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.372416 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.373128 (+ 712us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.373272 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.373366 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.373582 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.373668 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:49:05.374289 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.367001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:33327 (local address 127.12.145.1:57559)
0811 06:49:05.367689 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:05.367706 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:05.367824 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:05.368200 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:05.368205 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:05.368218 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:49:05.368671 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.368687 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.370173 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.370178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.371449 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.371463 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.372666 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.372674 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.372881 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.372949 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.373381 (+ 432us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.373394 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 06:49:05.373803 (+ 409us) client_negotiation.cc:240] Negotiation successful
0811 06:49:05.373954 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":404,"threads_started":1}
I20260811 06:49:05.417826 15798 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:05.418169 15798 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:05.422233 15798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d: Sending DeleteTablet for 3 replicas of tablet 5616a2dd06994a5188fbf250cdd150ed
I20260811 06:49:05.423454 16468 tablet_service.cc:1514] Processing DeleteTablet for tablet 5616a2dd06994a5188fbf250cdd150ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:05 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:46896
I20260811 06:49:05.423482 16037 tablet_service.cc:1514] Processing DeleteTablet for tablet 5616a2dd06994a5188fbf250cdd150ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:05 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:37630
I20260811 06:49:05.424768 16246 tablet_service.cc:1514] Processing DeleteTablet for tablet 5616a2dd06994a5188fbf250cdd150ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:05 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:43600
I20260811 06:49:05.431105 15798 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:49:05.431813 15798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:49:05.439652 16467 tablet_service.cc:1467] Processing CreateTablet for tablet b9b73e19eeab4beb8dfea3429eecddfe (DEFAULT_TABLE table=test-table [id=c352751ad25844e989f2d273f0c7d5a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:05.440308 16467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9b73e19eeab4beb8dfea3429eecddfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:05.442286 16245 tablet_service.cc:1467] Processing CreateTablet for tablet b9b73e19eeab4beb8dfea3429eecddfe (DEFAULT_TABLE table=test-table [id=c352751ad25844e989f2d273f0c7d5a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:05.442795 16245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9b73e19eeab4beb8dfea3429eecddfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:05.443202 16701 tablet_replica.cc:330] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: stopping tablet replica
I20260811 06:49:05.443671 16701 raft_consensus.cc:2229] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:49:05.444304 16701 raft_consensus.cc:2258] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:05.445042 16696 tablet_replica.cc:330] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: stopping tablet replica
I20260811 06:49:05.445461 16696 raft_consensus.cc:2229] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:05.445842 16696 raft_consensus.cc:2258] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:05.446332 16035 tablet_service.cc:1467] Processing CreateTablet for tablet b9b73e19eeab4beb8dfea3429eecddfe (DEFAULT_TABLE table=test-table [id=c352751ad25844e989f2d273f0c7d5a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:05.446837 16035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9b73e19eeab4beb8dfea3429eecddfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:05.447966 16696 ts_tablet_manager.cc:1905] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:05.461475 16701 ts_tablet_manager.cc:1905] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:05.461813 16696 ts_tablet_manager.cc:1918] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:49:05.464018 16696 log.cc:1196] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/5616a2dd06994a5188fbf250cdd150ed
I20260811 06:49:05.464720 16696 ts_tablet_manager.cc:1939] T 5616a2dd06994a5188fbf250cdd150ed P 47a312485f81407a95a6fa8ded24a662: Deleting consensus metadata
I20260811 06:49:05.466784 15776 catalog_manager.cc:4841] TS 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709): tablet 5616a2dd06994a5188fbf250cdd150ed (table test-table [id=3540ca40b3784408862a50e911172d09]) successfully deleted
I20260811 06:49:05.468940 16703 tablet_bootstrap.cc:492] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad: Bootstrap starting.
I20260811 06:49:05.472193 16705 tablet_bootstrap.cc:492] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662: Bootstrap starting.
I20260811 06:49:05.472568 16704 tablet_bootstrap.cc:492] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270: Bootstrap starting.
I20260811 06:49:05.472903 16702 tablet_replica.cc:330] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: stopping tablet replica
I20260811 06:49:05.473385 16702 raft_consensus.cc:2229] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:05.473884 16702 raft_consensus.cc:2258] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:05.474606 16704 tablet_bootstrap.cc:654] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:05.474608 16705 tablet_bootstrap.cc:654] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:05.475736 16701 ts_tablet_manager.cc:1918] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:49:05.475919 16701 log.cc:1196] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/5616a2dd06994a5188fbf250cdd150ed
I20260811 06:49:05.476506 16701 ts_tablet_manager.cc:1939] T 5616a2dd06994a5188fbf250cdd150ed P 01ecf7a031334d24b9591846dcc17aad: Deleting consensus metadata
I20260811 06:49:05.478166 15773 catalog_manager.cc:4841] TS 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327): tablet 5616a2dd06994a5188fbf250cdd150ed (table test-table [id=3540ca40b3784408862a50e911172d09]) successfully deleted
I20260811 06:49:05.479300 16703 tablet_bootstrap.cc:654] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:05.479918 16702 ts_tablet_manager.cc:1905] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:05.486750 16704 tablet_bootstrap.cc:492] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270: No bootstrap required, opened a new log
I20260811 06:49:05.486835 16703 tablet_bootstrap.cc:492] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad: No bootstrap required, opened a new log
I20260811 06:49:05.486912 16704 ts_tablet_manager.cc:1397] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.006s
I20260811 06:49:05.486985 16703 ts_tablet_manager.cc:1397] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260811 06:49:05.487555 16702 ts_tablet_manager.cc:1918] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:49:05.487751 16702 log.cc:1196] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/5616a2dd06994a5188fbf250cdd150ed
I20260811 06:49:05.487715 16704 raft_consensus.cc:348] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.487802 16703 raft_consensus.cc:348] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.487982 16704 raft_consensus.cc:374] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:05.488063 16703 raft_consensus.cc:374] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:05.488075 16704 raft_consensus.cc:729] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6724f97ac9a040ddbdf430fcb24a4270, State: Initialized, Role: FOLLOWER
I20260811 06:49:05.488158 16703 raft_consensus.cc:729] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01ecf7a031334d24b9591846dcc17aad, State: Initialized, Role: FOLLOWER
I20260811 06:49:05.488379 16704 consensus_queue.cc:260] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.488408 16703 consensus_queue.cc:260] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.488996 16703 ts_tablet_manager.cc:1428] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:49:05.489100 16702 ts_tablet_manager.cc:1939] T 5616a2dd06994a5188fbf250cdd150ed P 6724f97ac9a040ddbdf430fcb24a4270: Deleting consensus metadata
I20260811 06:49:05.489768 16704 ts_tablet_manager.cc:1428] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:49:05.490857 16705 tablet_bootstrap.cc:492] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662: No bootstrap required, opened a new log
I20260811 06:49:05.490996 16705 ts_tablet_manager.cc:1397] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.010s
I20260811 06:49:05.492205 16705 raft_consensus.cc:348] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.492486 16705 raft_consensus.cc:374] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:05.492578 16705 raft_consensus.cc:729] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a312485f81407a95a6fa8ded24a662, State: Initialized, Role: FOLLOWER
I20260811 06:49:05.492805 16705 consensus_queue.cc:260] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.493404 16705 ts_tablet_manager.cc:1428] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 06:49:05.494869 15776 catalog_manager.cc:4841] TS 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535): tablet 5616a2dd06994a5188fbf250cdd150ed (table test-table [id=3540ca40b3784408862a50e911172d09]) successfully deleted
I20260811 06:49:05.560827 16622 raft_consensus.cc:482] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:05.561090 16622 raft_consensus.cc:504] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.563326 16622 leader_election.cc:288] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709), 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327)
I20260811 06:49:05.583534 16660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.564269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:46031 (local address 127.12.145.3:33327)
0811 06:49:05.564474 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.564480 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.575292 (+ 10812us) server_negotiation.cc:407] Connection header received
0811 06:49:05.575866 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.575873 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.575964 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.576035 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:05.577001 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.578182 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.580855 (+ 2673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.582251 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.582418 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.582498 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.583069 (+ 571us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.583217 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 06:49:05.583731 16672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.564620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:50161 (local address 127.12.145.1:45709)
0811 06:49:05.564805 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.564810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.575676 (+ 10866us) server_negotiation.cc:407] Connection header received
0811 06:49:05.576196 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.576205 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.576307 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.576374 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:05.577316 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.578485 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.581094 (+ 2609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.582459 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.582614 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.582693 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.583291 (+ 598us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.583449 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 06:49:05.584435 16716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.563819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:33327 (local address 127.12.145.2:46031)
0811 06:49:05.575161 (+ 11342us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:05.575182 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:05.575644 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:05.576277 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:05.576281 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:05.576320 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:05.576773 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.576794 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.578400 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.578405 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.580667 (+ 2262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.580684 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.582665 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.582671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.582862 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.582899 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 06:49:05.583828 (+ 929us) client_negotiation.cc:240] Negotiation successful
0811 06:49:05.584075 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11188,"thread_start_us":11506,"threads_started":1}
I20260811 06:49:05.585229 16715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.563527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45709 (local address 127.12.145.2:50161)
0811 06:49:05.574582 (+ 11055us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:05.574608 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:05.575987 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:05.576594 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:05.576599 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:05.576625 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:05.577111 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.577126 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.578679 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.578684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.580898 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.580915 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.582901 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.582908 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.583100 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.583133 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 06:49:05.584350 (+ 1217us) client_negotiation.cc:240] Negotiation successful
0811 06:49:05.584869 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10897,"thread_start_us":12197,"threads_started":1}
I20260811 06:49:05.585173 16500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b73e19eeab4beb8dfea3429eecddfe" candidate_uuid: "6724f97ac9a040ddbdf430fcb24a4270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01ecf7a031334d24b9591846dcc17aad" is_pre_election: true
I20260811 06:49:05.585495 16500 raft_consensus.cc:2454] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6724f97ac9a040ddbdf430fcb24a4270 in term 0.
I20260811 06:49:05.586149 16172 leader_election.cc:302] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01ecf7a031334d24b9591846dcc17aad, 6724f97ac9a040ddbdf430fcb24a4270; no voters:
I20260811 06:49:05.586804 16622 raft_consensus.cc:2781] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:49:05.586921 16622 raft_consensus.cc:482] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:49:05.587034 16622 raft_consensus.cc:3037] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:05.587978 16063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b73e19eeab4beb8dfea3429eecddfe" candidate_uuid: "6724f97ac9a040ddbdf430fcb24a4270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a312485f81407a95a6fa8ded24a662" is_pre_election: true
I20260811 06:49:05.588294 16063 raft_consensus.cc:2454] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6724f97ac9a040ddbdf430fcb24a4270 in term 0.
I20260811 06:49:05.590435 16622 raft_consensus.cc:504] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.591239 16622 leader_election.cc:288] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [CANDIDATE]: Term 1 election: Requested vote from peers 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709), 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327)
I20260811 06:49:05.591734 16063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b73e19eeab4beb8dfea3429eecddfe" candidate_uuid: "6724f97ac9a040ddbdf430fcb24a4270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a312485f81407a95a6fa8ded24a662"
I20260811 06:49:05.591965 16063 raft_consensus.cc:3037] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:05.591939 16500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9b73e19eeab4beb8dfea3429eecddfe" candidate_uuid: "6724f97ac9a040ddbdf430fcb24a4270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01ecf7a031334d24b9591846dcc17aad"
I20260811 06:49:05.592165 16500 raft_consensus.cc:3037] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:05.595309 16063 raft_consensus.cc:2454] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6724f97ac9a040ddbdf430fcb24a4270 in term 1.
I20260811 06:49:05.595468 16500 raft_consensus.cc:2454] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6724f97ac9a040ddbdf430fcb24a4270 in term 1.
I20260811 06:49:05.595894 16174 leader_election.cc:302] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a312485f81407a95a6fa8ded24a662, 6724f97ac9a040ddbdf430fcb24a4270; no voters:
I20260811 06:49:05.596268 16622 raft_consensus.cc:2781] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:05.597159 16622 raft_consensus.cc:686] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 LEADER]: Becoming Leader. State: Replica: 6724f97ac9a040ddbdf430fcb24a4270, State: Running, Role: LEADER
I20260811 06:49:05.597954 16622 consensus_queue.cc:237] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:05.602334 15797 catalog_manager.cc:5495] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2). New cstate: current_term: 1 leader_uuid: "6724f97ac9a040ddbdf430fcb24a4270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } health_report { overall_health: UNKNOWN } } }
I20260811 06:49:05.642347 16663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.634250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43610 (local address 127.12.145.2:45535)
0811 06:49:05.634448 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.634454 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.634534 (+ 80us) server_negotiation.cc:407] Connection header received
0811 06:49:05.634758 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.634763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.634885 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.635061 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:05.635824 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.636930 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.639093 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.639732 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.639860 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.640511 (+ 651us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.641275 (+ 764us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.641435 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.641946 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.642042 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 06:49:05.661440 16672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.654516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:37797 (local address 127.12.145.1:45709)
0811 06:49:05.654845 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.654852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.655268 (+ 416us) server_negotiation.cc:407] Connection header received
0811 06:49:05.655463 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.655469 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.655552 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.655640 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:05.656151 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.657287 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.659287 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.659960 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.660107 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.660635 (+ 528us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.660813 (+ 178us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.660908 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.661037 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.661131 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195}
I20260811 06:49:05.661567 16727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.654492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45709 (local address 127.12.145.2:37797)
0811 06:49:05.655161 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:05.655180 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:05.655335 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:05.655656 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:05.655661 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:05.655672 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:49:05.655990 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.656002 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.657440 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.657445 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.659117 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.659133 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.660171 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.660177 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.660373 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.660443 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.660918 (+ 475us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.660929 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 06:49:05.661004 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 06:49:05.661151 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":366,"threads_started":1}
I20260811 06:49:05.672201 16063 raft_consensus.cc:1261] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Refusing update from remote peer 6724f97ac9a040ddbdf430fcb24a4270: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:05.675326 16717 consensus_queue.cc:1035] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:05.681435 16656 mvcc.cc:205] Tried to move back new op lower bound from 7317221153465655296 to 7317221153174589440. Current Snapshot: MvccSnapshot[applied={T|T < 7317221153465655296}]
I20260811 06:49:05.687980 16499 raft_consensus.cc:1261] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Refusing update from remote peer 6724f97ac9a040ddbdf430fcb24a4270: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:05.689133 16622 consensus_queue.cc:1035] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:05.709492 16651 mvcc.cc:205] Tried to move back new op lower bound from 7317221153465655296 to 7317221153174589440. Current Snapshot: MvccSnapshot[applied={T|T < 7317221153465655296}]
I20260811 06:49:05.719668 16663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.712517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:36821 (local address 127.12.145.2:45535)
0811 06:49:05.712678 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:05.712684 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:05.713769 (+ 1085us) server_negotiation.cc:407] Connection header received
0811 06:49:05.713836 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:05.713841 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:05.713918 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:05.714003 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:05.714694 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.715777 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.717616 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.718172 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.718305 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.718869 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.719001 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.719092 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:05.719302 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 06:49:05.719380 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 06:49:05.719766 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:05.712453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:45535 (local address 127.12.145.1:36821)
0811 06:49:05.712687 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:05.712706 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:05.712831 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:05.714385 (+ 1554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:05.714390 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:05.714403 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:49:05.714557 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.714567 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.715962 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.715967 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.717420 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:05.717436 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:05.718432 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:05.718438 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:05.718606 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:05.718663 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:49:05.719132 (+ 469us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:49:05.719148 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 06:49:05.719253 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 06:49:05.719426 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
W20260811 06:49:05.721087 16656 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 06:49:07.327235 15797 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:07.327487 15797 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:07.331924 15797 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d: Sending DeleteTablet for 3 replicas of tablet b9b73e19eeab4beb8dfea3429eecddfe
I20260811 06:49:07.332703 16035 tablet_service.cc:1514] Processing DeleteTablet for tablet b9b73e19eeab4beb8dfea3429eecddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:07 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:37630
I20260811 06:49:07.332799 16246 tablet_service.cc:1514] Processing DeleteTablet for tablet b9b73e19eeab4beb8dfea3429eecddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:07 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:43600
I20260811 06:49:07.332823 16467 tablet_service.cc:1514] Processing DeleteTablet for tablet b9b73e19eeab4beb8dfea3429eecddfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:07 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:46896
I20260811 06:49:07.333475 16766 tablet_replica.cc:330] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270: stopping tablet replica
I20260811 06:49:07.333707 16766 raft_consensus.cc:2229] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:49:07.337714 16766 raft_consensus.cc:2258] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:07.338591 16766 ts_tablet_manager.cc:1905] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:07.344087 16766 ts_tablet_manager.cc:1918] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 06:49:07.344218 16766 log.cc:1196] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/b9b73e19eeab4beb8dfea3429eecddfe
I20260811 06:49:07.344657 16766 ts_tablet_manager.cc:1939] T b9b73e19eeab4beb8dfea3429eecddfe P 6724f97ac9a040ddbdf430fcb24a4270: Deleting consensus metadata
I20260811 06:49:07.344869 16765 tablet_replica.cc:330] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662: stopping tablet replica
I20260811 06:49:07.345140 16765 raft_consensus.cc:2229] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:07.345450 16765 raft_consensus.cc:2258] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:07.345909 15776 catalog_manager.cc:4841] TS 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535): tablet b9b73e19eeab4beb8dfea3429eecddfe (table test-table [id=c352751ad25844e989f2d273f0c7d5a9]) successfully deleted
I20260811 06:49:07.346637 16765 ts_tablet_manager.cc:1905] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:07.353127 16765 ts_tablet_manager.cc:1918] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 06:49:07.353276 16765 log.cc:1196] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/b9b73e19eeab4beb8dfea3429eecddfe
I20260811 06:49:07.353767 16765 ts_tablet_manager.cc:1939] T b9b73e19eeab4beb8dfea3429eecddfe P 47a312485f81407a95a6fa8ded24a662: Deleting consensus metadata
I20260811 06:49:07.354044 16769 tablet_replica.cc:330] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad: stopping tablet replica
I20260811 06:49:07.354252 16769 raft_consensus.cc:2229] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:07.355008 15776 catalog_manager.cc:4841] TS 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709): tablet b9b73e19eeab4beb8dfea3429eecddfe (table test-table [id=c352751ad25844e989f2d273f0c7d5a9]) successfully deleted
I20260811 06:49:07.356916 16769 raft_consensus.cc:2258] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:07.361341 16769 ts_tablet_manager.cc:1905] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:07.366648 16769 ts_tablet_manager.cc:1918] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 06:49:07.366788 16769 log.cc:1196] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/b9b73e19eeab4beb8dfea3429eecddfe
I20260811 06:49:07.367149 16769 ts_tablet_manager.cc:1939] T b9b73e19eeab4beb8dfea3429eecddfe P 01ecf7a031334d24b9591846dcc17aad: Deleting consensus metadata
I20260811 06:49:07.368180 15773 catalog_manager.cc:4841] TS 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327): tablet b9b73e19eeab4beb8dfea3429eecddfe (table test-table [id=c352751ad25844e989f2d273f0c7d5a9]) successfully deleted
Aug 11 06:49:07 dist-test-slave-7lbf krb5kdc[15719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430947, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 06:49:07 dist-test-slave-7lbf krb5kdc[15719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430947, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:07.410010 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:07.396153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37932 (local address 127.12.145.62:34353)
0811 06:49:07.397032 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:07.397038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:07.397064 (+ 26us) server_negotiation.cc:407] Connection header received
0811 06:49:07.397129 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:07.397135 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:07.397226 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:07.397345 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:07.398642 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:07.399484 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:07.400690 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:07.401111 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:07.401226 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:07.405070 (+ 3844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:07.405075 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:07.405078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:07.405114 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:07.407744 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:07.408376 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:07.408381 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:07.408383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:07.408522 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:07.408807 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:07.408810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:07.408812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:07.409069 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:07.409259 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:07.409455 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 06:49:07.409680 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":743,"thread_start_us":579,"threads_started":1}
I20260811 06:49:07.413388 15797 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:49:07.414072 15797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:49:07.420787 16035 tablet_service.cc:1467] Processing CreateTablet for tablet be921ea01ab04146b5929e91decd27dd (DEFAULT_TABLE table=test-table [id=2251de187a384b738d345cdae3044ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:07.420831 16246 tablet_service.cc:1467] Processing CreateTablet for tablet be921ea01ab04146b5929e91decd27dd (DEFAULT_TABLE table=test-table [id=2251de187a384b738d345cdae3044ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:07.421283 16246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be921ea01ab04146b5929e91decd27dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:07.421289 16035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be921ea01ab04146b5929e91decd27dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:07.421219 16467 tablet_service.cc:1467] Processing CreateTablet for tablet be921ea01ab04146b5929e91decd27dd (DEFAULT_TABLE table=test-table [id=2251de187a384b738d345cdae3044ad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:07.421741 16467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be921ea01ab04146b5929e91decd27dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:07.428247 16783 tablet_bootstrap.cc:492] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662: Bootstrap starting.
I20260811 06:49:07.428520 16780 tablet_bootstrap.cc:492] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad: Bootstrap starting.
I20260811 06:49:07.429980 16783 tablet_bootstrap.cc:654] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:07.430320 16780 tablet_bootstrap.cc:654] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:07.432639 16783 tablet_bootstrap.cc:492] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662: No bootstrap required, opened a new log
I20260811 06:49:07.432789 16783 ts_tablet_manager.cc:1397] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 06:49:07.433635 16784 tablet_bootstrap.cc:492] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270: Bootstrap starting.
I20260811 06:49:07.433467 16783 raft_consensus.cc:348] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.433749 16783 raft_consensus.cc:374] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:07.433864 16783 raft_consensus.cc:729] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a312485f81407a95a6fa8ded24a662, State: Initialized, Role: FOLLOWER
I20260811 06:49:07.434130 16783 consensus_queue.cc:260] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.434790 16783 ts_tablet_manager.cc:1428] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:49:07.435530 16780 tablet_bootstrap.cc:492] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad: No bootstrap required, opened a new log
I20260811 06:49:07.435585 16784 tablet_bootstrap.cc:654] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:07.435778 16780 ts_tablet_manager.cc:1397] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 06:49:07.436679 16780 raft_consensus.cc:348] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.436968 16780 raft_consensus.cc:374] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:07.437086 16780 raft_consensus.cc:729] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01ecf7a031334d24b9591846dcc17aad, State: Initialized, Role: FOLLOWER
I20260811 06:49:07.437354 16780 consensus_queue.cc:260] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.438282 16784 tablet_bootstrap.cc:492] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270: No bootstrap required, opened a new log
I20260811 06:49:07.438423 16784 ts_tablet_manager.cc:1397] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 06:49:07.438426 16780 ts_tablet_manager.cc:1428] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:49:07.439352 16784 raft_consensus.cc:348] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.439543 16784 raft_consensus.cc:374] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:07.439630 16784 raft_consensus.cc:729] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6724f97ac9a040ddbdf430fcb24a4270, State: Initialized, Role: FOLLOWER
I20260811 06:49:07.439859 16784 consensus_queue.cc:260] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.440522 16784 ts_tablet_manager.cc:1428] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:49:07.444114 16717 raft_consensus.cc:482] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:07.444255 16717 raft_consensus.cc:504] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.444742 16717 leader_election.cc:288] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709), 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327)
I20260811 06:49:07.445214 16063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be921ea01ab04146b5929e91decd27dd" candidate_uuid: "6724f97ac9a040ddbdf430fcb24a4270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a312485f81407a95a6fa8ded24a662" is_pre_election: true
I20260811 06:49:07.445231 16500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be921ea01ab04146b5929e91decd27dd" candidate_uuid: "6724f97ac9a040ddbdf430fcb24a4270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01ecf7a031334d24b9591846dcc17aad" is_pre_election: true
I20260811 06:49:07.445433 16063 raft_consensus.cc:2454] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6724f97ac9a040ddbdf430fcb24a4270 in term 0.
I20260811 06:49:07.445542 16500 raft_consensus.cc:2454] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6724f97ac9a040ddbdf430fcb24a4270 in term 0.
I20260811 06:49:07.445869 16174 leader_election.cc:302] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a312485f81407a95a6fa8ded24a662, 6724f97ac9a040ddbdf430fcb24a4270; no voters:
I20260811 06:49:07.446188 16717 raft_consensus.cc:2781] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:49:07.446302 16717 raft_consensus.cc:482] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:49:07.446415 16717 raft_consensus.cc:3037] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:07.448483 16717 raft_consensus.cc:504] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.448983 16717 leader_election.cc:288] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [CANDIDATE]: Term 1 election: Requested vote from peers 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709), 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327)
I20260811 06:49:07.449437 16063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be921ea01ab04146b5929e91decd27dd" candidate_uuid: "6724f97ac9a040ddbdf430fcb24a4270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a312485f81407a95a6fa8ded24a662"
I20260811 06:49:07.449676 16063 raft_consensus.cc:3037] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:07.451607 16063 raft_consensus.cc:2454] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6724f97ac9a040ddbdf430fcb24a4270 in term 1.
I20260811 06:49:07.451889 16500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be921ea01ab04146b5929e91decd27dd" candidate_uuid: "6724f97ac9a040ddbdf430fcb24a4270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01ecf7a031334d24b9591846dcc17aad"
I20260811 06:49:07.451973 16174 leader_election.cc:302] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a312485f81407a95a6fa8ded24a662, 6724f97ac9a040ddbdf430fcb24a4270; no voters:
I20260811 06:49:07.452090 16500 raft_consensus.cc:3037] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:07.452286 16717 raft_consensus.cc:2781] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:07.452486 16717 raft_consensus.cc:686] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 LEADER]: Becoming Leader. State: Replica: 6724f97ac9a040ddbdf430fcb24a4270, State: Running, Role: LEADER
I20260811 06:49:07.452747 16717 consensus_queue.cc:237] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.454824 16500 raft_consensus.cc:2454] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6724f97ac9a040ddbdf430fcb24a4270 in term 1.
I20260811 06:49:07.455653 15792 catalog_manager.cc:5495] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2). New cstate: current_term: 1 leader_uuid: "6724f97ac9a040ddbdf430fcb24a4270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } health_report { overall_health: UNKNOWN } } }
I20260811 06:49:07.479322 16794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:07.474243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43624 (local address 127.12.145.2:45535)
0811 06:49:07.474887 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:07.474891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:07.474909 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:49:07.474960 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:07.474963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:07.475032 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:07.475117 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:07.475506 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:07.476269 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:07.477626 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:07.478066 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:07.478181 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:07.478600 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:07.478716 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:07.478791 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:07.478937 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 06:49:07.479022 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":313,"threads_started":1}
I20260811 06:49:07.488060 16500 raft_consensus.cc:1261] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Refusing update from remote peer 6724f97ac9a040ddbdf430fcb24a4270: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:07.488173 16063 raft_consensus.cc:1261] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Refusing update from remote peer 6724f97ac9a040ddbdf430fcb24a4270: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:07.488780 16758 consensus_queue.cc:1035] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:07.489097 16717 consensus_queue.cc:1035] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:07.532697 15797 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:07.532922 15797 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:07.536005 15797 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d: Sending DeleteTablet for 3 replicas of tablet be921ea01ab04146b5929e91decd27dd
I20260811 06:49:07.536903 16035 tablet_service.cc:1514] Processing DeleteTablet for tablet be921ea01ab04146b5929e91decd27dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:07 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:37630
I20260811 06:49:07.537036 16467 tablet_service.cc:1514] Processing DeleteTablet for tablet be921ea01ab04146b5929e91decd27dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:07 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:46896
I20260811 06:49:07.536958 16246 tablet_service.cc:1514] Processing DeleteTablet for tablet be921ea01ab04146b5929e91decd27dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:07 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:43600
I20260811 06:49:07.537348 16765 tablet_replica.cc:330] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662: stopping tablet replica
I20260811 06:49:07.537364 16769 tablet_replica.cc:330] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad: stopping tablet replica
I20260811 06:49:07.537536 16765 raft_consensus.cc:2229] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:07.537623 16769 raft_consensus.cc:2229] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:07.537710 16765 raft_consensus.cc:2258] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:07.537851 16769 raft_consensus.cc:2258] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:07.538043 16766 tablet_replica.cc:330] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270: stopping tablet replica
I20260811 06:49:07.538244 16766 raft_consensus.cc:2229] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:49:07.538597 16766 raft_consensus.cc:2258] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:07.538429 15797 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:49:07.539126 16769 ts_tablet_manager.cc:1905] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:49:07.539188 15797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:49:07.539556 16766 ts_tablet_manager.cc:1905] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:07.540318 16765 ts_tablet_manager.cc:1905] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:07.544445 16769 ts_tablet_manager.cc:1918] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:49:07.544607 16769 log.cc:1196] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/be921ea01ab04146b5929e91decd27dd
I20260811 06:49:07.545058 16769 ts_tablet_manager.cc:1939] T be921ea01ab04146b5929e91decd27dd P 01ecf7a031334d24b9591846dcc17aad: Deleting consensus metadata
I20260811 06:49:07.546054 16766 ts_tablet_manager.cc:1918] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:49:07.546208 16766 log.cc:1196] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/be921ea01ab04146b5929e91decd27dd
I20260811 06:49:07.546307 15773 catalog_manager.cc:4841] TS 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327): tablet be921ea01ab04146b5929e91decd27dd (table test-table [id=2251de187a384b738d345cdae3044ad7]) successfully deleted
I20260811 06:49:07.546576 16766 ts_tablet_manager.cc:1939] T be921ea01ab04146b5929e91decd27dd P 6724f97ac9a040ddbdf430fcb24a4270: Deleting consensus metadata
I20260811 06:49:07.547217 16765 ts_tablet_manager.cc:1918] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:49:07.547379 16765 log.cc:1196] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/be921ea01ab04146b5929e91decd27dd
I20260811 06:49:07.547588 15776 catalog_manager.cc:4841] TS 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535): tablet be921ea01ab04146b5929e91decd27dd (table test-table [id=2251de187a384b738d345cdae3044ad7]) successfully deleted
I20260811 06:49:07.547797 16765 ts_tablet_manager.cc:1939] T be921ea01ab04146b5929e91decd27dd P 47a312485f81407a95a6fa8ded24a662: Deleting consensus metadata
I20260811 06:49:07.548810 15776 catalog_manager.cc:4841] TS 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709): tablet be921ea01ab04146b5929e91decd27dd (table test-table [id=2251de187a384b738d345cdae3044ad7]) successfully deleted
I20260811 06:49:07.551553 16246 tablet_service.cc:1467] Processing CreateTablet for tablet 5bed92709cb24587a3c03341b2aa7c53 (DEFAULT_TABLE table=test-table [id=827e8191400b4a818c64905f3a267756]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:07.551574 16035 tablet_service.cc:1467] Processing CreateTablet for tablet 5bed92709cb24587a3c03341b2aa7c53 (DEFAULT_TABLE table=test-table [id=827e8191400b4a818c64905f3a267756]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:07.551723 16467 tablet_service.cc:1467] Processing CreateTablet for tablet 5bed92709cb24587a3c03341b2aa7c53 (DEFAULT_TABLE table=test-table [id=827e8191400b4a818c64905f3a267756]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:07.551980 16035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bed92709cb24587a3c03341b2aa7c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:07.552000 16246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bed92709cb24587a3c03341b2aa7c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:07.552130 16467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bed92709cb24587a3c03341b2aa7c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:07.556710 16780 tablet_bootstrap.cc:492] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad: Bootstrap starting.
I20260811 06:49:07.558269 16784 tablet_bootstrap.cc:492] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270: Bootstrap starting.
I20260811 06:49:07.558287 16780 tablet_bootstrap.cc:654] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:07.558925 16783 tablet_bootstrap.cc:492] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662: Bootstrap starting.
I20260811 06:49:07.560052 16784 tablet_bootstrap.cc:654] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:07.560539 16783 tablet_bootstrap.cc:654] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:07.560654 16780 tablet_bootstrap.cc:492] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad: No bootstrap required, opened a new log
I20260811 06:49:07.560799 16780 ts_tablet_manager.cc:1397] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:49:07.561630 16780 raft_consensus.cc:348] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.561913 16780 raft_consensus.cc:374] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:07.561990 16780 raft_consensus.cc:729] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01ecf7a031334d24b9591846dcc17aad, State: Initialized, Role: FOLLOWER
I20260811 06:49:07.562266 16780 consensus_queue.cc:260] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.562857 16780 ts_tablet_manager.cc:1428] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:49:07.563127 16783 tablet_bootstrap.cc:492] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662: No bootstrap required, opened a new log
I20260811 06:49:07.563278 16783 ts_tablet_manager.cc:1397] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:49:07.563594 16784 tablet_bootstrap.cc:492] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270: No bootstrap required, opened a new log
I20260811 06:49:07.563763 16784 ts_tablet_manager.cc:1397] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 06:49:07.563941 16783 raft_consensus.cc:348] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.564131 16783 raft_consensus.cc:374] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:07.564213 16783 raft_consensus.cc:729] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a312485f81407a95a6fa8ded24a662, State: Initialized, Role: FOLLOWER
I20260811 06:49:07.564445 16783 consensus_queue.cc:260] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.564512 16784 raft_consensus.cc:348] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.564778 16784 raft_consensus.cc:374] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:07.564873 16783 ts_tablet_manager.cc:1428] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:49:07.564870 16784 raft_consensus.cc:729] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6724f97ac9a040ddbdf430fcb24a4270, State: Initialized, Role: FOLLOWER
I20260811 06:49:07.565109 16784 consensus_queue.cc:260] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.565770 16784 ts_tablet_manager.cc:1428] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:49:07.933437 16745 raft_consensus.cc:482] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:07.933692 16745 raft_consensus.cc:504] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.934399 16745 leader_election.cc:288] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535), 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327)
I20260811 06:49:07.935015 16281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bed92709cb24587a3c03341b2aa7c53" candidate_uuid: "47a312485f81407a95a6fa8ded24a662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6724f97ac9a040ddbdf430fcb24a4270" is_pre_election: true
I20260811 06:49:07.935015 16500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bed92709cb24587a3c03341b2aa7c53" candidate_uuid: "47a312485f81407a95a6fa8ded24a662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01ecf7a031334d24b9591846dcc17aad" is_pre_election: true
I20260811 06:49:07.935302 16500 raft_consensus.cc:2454] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47a312485f81407a95a6fa8ded24a662 in term 0.
I20260811 06:49:07.935302 16281 raft_consensus.cc:2454] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47a312485f81407a95a6fa8ded24a662 in term 0.
I20260811 06:49:07.935794 15951 leader_election.cc:302] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01ecf7a031334d24b9591846dcc17aad, 47a312485f81407a95a6fa8ded24a662; no voters:
I20260811 06:49:07.936079 16745 raft_consensus.cc:2781] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:49:07.936198 16745 raft_consensus.cc:482] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:49:07.936280 16745 raft_consensus.cc:3037] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:07.938531 16745 raft_consensus.cc:504] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.939075 16745 leader_election.cc:288] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [CANDIDATE]: Term 1 election: Requested vote from peers 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535), 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327)
I20260811 06:49:07.939517 16281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bed92709cb24587a3c03341b2aa7c53" candidate_uuid: "47a312485f81407a95a6fa8ded24a662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6724f97ac9a040ddbdf430fcb24a4270"
I20260811 06:49:07.939549 16500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bed92709cb24587a3c03341b2aa7c53" candidate_uuid: "47a312485f81407a95a6fa8ded24a662" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01ecf7a031334d24b9591846dcc17aad"
I20260811 06:49:07.939708 16281 raft_consensus.cc:3037] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:07.939785 16500 raft_consensus.cc:3037] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:07.941754 16281 raft_consensus.cc:2454] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a312485f81407a95a6fa8ded24a662 in term 1.
I20260811 06:49:07.942039 16500 raft_consensus.cc:2454] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a312485f81407a95a6fa8ded24a662 in term 1.
I20260811 06:49:07.942137 15953 leader_election.cc:302] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a312485f81407a95a6fa8ded24a662, 6724f97ac9a040ddbdf430fcb24a4270; no voters:
I20260811 06:49:07.942449 16745 raft_consensus.cc:2781] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:07.942595 16745 raft_consensus.cc:686] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 1 LEADER]: Becoming Leader. State: Replica: 47a312485f81407a95a6fa8ded24a662, State: Running, Role: LEADER
I20260811 06:49:07.942893 16745 consensus_queue.cc:237] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } }
I20260811 06:49:07.945391 15798 catalog_manager.cc:5495] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47a312485f81407a95a6fa8ded24a662 (127.12.145.1). New cstate: current_term: 1 leader_uuid: "47a312485f81407a95a6fa8ded24a662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a312485f81407a95a6fa8ded24a662" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 } health_report { overall_health: UNKNOWN } } }
I20260811 06:49:08.032032 16814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:08.026917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34998 (local address 127.12.145.1:45709)
0811 06:49:08.027586 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:08.027590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:08.027606 (+ 16us) server_negotiation.cc:407] Connection header received
0811 06:49:08.027656 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:08.027659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:08.027718 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:08.027799 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:08.028178 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:08.028962 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:08.030274 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:08.030823 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:08.030926 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:08.031312 (+ 386us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:08.031430 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:08.031497 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:08.031590 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 06:49:08.031657 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":476,"threads_started":1}
I20260811 06:49:08.044720 16814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:08.040220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:40581 (local address 127.12.145.1:45709)
0811 06:49:08.040398 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:08.040404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:08.040600 (+ 196us) server_negotiation.cc:407] Connection header received
0811 06:49:08.040753 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:08.040757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:08.040812 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:08.040879 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:08.041271 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:08.042012 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:08.043270 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:08.043642 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:08.043746 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:08.044093 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:08.044183 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:08.044254 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:08.044372 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 06:49:08.044436 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 06:49:08.044865 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:08.039988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45709 (local address 127.12.145.1:40581)
0811 06:49:08.040511 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:08.040526 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:08.040651 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:08.040899 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:08.040903 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:08.040913 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:49:08.041143 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:08.041151 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:08.042142 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:08.042148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:08.043141 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:08.043153 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:08.043777 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:08.043783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:08.043914 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:08.043947 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:49:08.044272 (+ 325us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:49:08.044282 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 06:49:08.044347 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 06:49:08.044483 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":1,"thread_start_us":265,"threads_started":1}
I20260811 06:49:08.052044 16281 raft_consensus.cc:1261] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Refusing update from remote peer 47a312485f81407a95a6fa8ded24a662: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:08.052073 16500 raft_consensus.cc:1261] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Refusing update from remote peer 47a312485f81407a95a6fa8ded24a662: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:08.052551 16745 consensus_queue.cc:1035] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6724f97ac9a040ddbdf430fcb24a4270" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:08.052788 16808 consensus_queue.cc:1035] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01ecf7a031334d24b9591846dcc17aad" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:49:08.072100 16733 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 06:49:09.663868 15792 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:09.664119 15792 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:09.668294 15792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e37dee8602ce42128852753d9139f40d: Sending DeleteTablet for 3 replicas of tablet 5bed92709cb24587a3c03341b2aa7c53
I20260811 06:49:09.669077 16035 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bed92709cb24587a3c03341b2aa7c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:09 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:37630
I20260811 06:49:09.669176 16467 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bed92709cb24587a3c03341b2aa7c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:09 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:46896
I20260811 06:49:09.669207 16246 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bed92709cb24587a3c03341b2aa7c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:09 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:43600
I20260811 06:49:09.670197 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15920
I20260811 06:49:09.681989 16861 tablet_replica.cc:330] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662: stopping tablet replica
I20260811 06:49:09.682404 16861 raft_consensus.cc:2229] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:49:09.683208 16861 raft_consensus.cc:2258] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:09.684448 16861 ts_tablet_manager.cc:1905] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:09.692106 16861 ts_tablet_manager.cc:1918] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 06:49:09.692363 16861 log.cc:1196] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/5bed92709cb24587a3c03341b2aa7c53
I20260811 06:49:09.692910 16861 ts_tablet_manager.cc:1939] T 5bed92709cb24587a3c03341b2aa7c53 P 47a312485f81407a95a6fa8ded24a662: Deleting consensus metadata
I20260811 06:49:09.693872 16864 tablet_replica.cc:330] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad: stopping tablet replica
I20260811 06:49:09.694242 15776 catalog_manager.cc:4841] TS 47a312485f81407a95a6fa8ded24a662 (127.12.145.1:45709): tablet 5bed92709cb24587a3c03341b2aa7c53 (table test-table [id=827e8191400b4a818c64905f3a267756]) successfully deleted
I20260811 06:49:09.694391 16866 tablet_replica.cc:330] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270: stopping tablet replica
I20260811 06:49:09.694583 16866 raft_consensus.cc:2229] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:09.694828 16866 raft_consensus.cc:2258] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:09.695214 16864 raft_consensus.cc:2229] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:09.695544 16864 raft_consensus.cc:2258] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:09.695822 16866 ts_tablet_manager.cc:1905] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:09.696554 16864 ts_tablet_manager.cc:1905] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 06:49:09 dist-test-slave-7lbf krb5kdc[15719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430947, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:49:09.702486 16866 ts_tablet_manager.cc:1918] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 06:49:09.702672 16866 log.cc:1196] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/5bed92709cb24587a3c03341b2aa7c53
I20260811 06:49:09.702934 16864 ts_tablet_manager.cc:1918] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 06:49:09.703089 16864 log.cc:1196] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/5bed92709cb24587a3c03341b2aa7c53
I20260811 06:49:09.703193 16866 ts_tablet_manager.cc:1939] T 5bed92709cb24587a3c03341b2aa7c53 P 6724f97ac9a040ddbdf430fcb24a4270: Deleting consensus metadata
I20260811 06:49:09.703521 16864 ts_tablet_manager.cc:1939] T 5bed92709cb24587a3c03341b2aa7c53 P 01ecf7a031334d24b9591846dcc17aad: Deleting consensus metadata
I20260811 06:49:09.704457 15776 catalog_manager.cc:4841] TS 6724f97ac9a040ddbdf430fcb24a4270 (127.12.145.2:45535): tablet 5bed92709cb24587a3c03341b2aa7c53 (table test-table [id=827e8191400b4a818c64905f3a267756]) successfully deleted
I20260811 06:49:09.704698 15773 catalog_manager.cc:4841] TS 01ecf7a031334d24b9591846dcc17aad (127.12.145.3:33327): tablet 5bed92709cb24587a3c03341b2aa7c53 (table test-table [id=827e8191400b4a818c64905f3a267756]) successfully deleted
I20260811 06:49:09.708140 16868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:09.680622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35008 (local address 127.12.145.1:45709)
0811 06:49:09.684118 (+ 3496us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:09.684124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:09.684149 (+ 25us) server_negotiation.cc:407] Connection header received
0811 06:49:09.684211 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:09.684216 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:09.684298 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:09.684412 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:09.687142 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:09.688269 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:09.691586 (+ 3317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:09.692251 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:09.692380 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:09.702060 (+ 9680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:09.702078 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:09.702095 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:09.702138 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:09.705390 (+ 3252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:09.706078 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:09.706088 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:09.706091 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:09.706227 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:09.706601 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:09.706606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:09.706610 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:09.706992 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:09.707266 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:09.707583 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 06:49:09.707800 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3376,"thread_start_us":3276,"threads_started":1}
W20260811 06:49:09.708763 16130 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35008
W20260811 06:49:09.709358 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15920: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:49:09.709648 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 15920
I20260811 06:49:09.745690 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16145
Aug 11 06:49:09 dist-test-slave-7lbf krb5kdc[15719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430947, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:49:09.759958 16869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:09.746404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59022 (local address 127.12.145.2:45535)
0811 06:49:09.746871 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:09.746875 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:09.746891 (+ 16us) server_negotiation.cc:407] Connection header received
0811 06:49:09.746945 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:09.746948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:09.747008 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:09.747096 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:09.748286 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:09.749050 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:09.750264 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:09.750838 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:09.750933 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:09.754788 (+ 3855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:09.754801 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:09.754817 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:09.754852 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:09.757578 (+ 2726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:09.758181 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:09.758188 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:09.758190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:09.758325 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:09.758626 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:09.758629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:09.758631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:09.758993 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:09.759203 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:09.759411 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 06:49:09.759630 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":230,"threads_started":1}
W20260811 06:49:09.760723 16362 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59022
W20260811 06:49:09.761363 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16145: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:49:09.761564 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 16145
I20260811 06:49:09.795495 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16375
Aug 11 06:49:09 dist-test-slave-7lbf krb5kdc[15719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430947, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:49:09.810577 16870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:09.796255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48360 (local address 127.12.145.3:33327)
0811 06:49:09.796785 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:09.796790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:09.796816 (+ 26us) server_negotiation.cc:407] Connection header received
0811 06:49:09.796875 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:09.796879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:09.796939 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:09.797036 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:09.798396 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:09.799218 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:09.800364 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:09.800770 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:09.800869 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:09.804958 (+ 4089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:09.804975 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:09.804993 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:09.805031 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:09.807950 (+ 2919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:09.808632 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:09.808640 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:09.808643 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:09.808854 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:09.809159 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:09.809162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:09.809164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:09.809575 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:09.809895 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:09.810031 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 06:49:09.810215 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":260,"threads_started":1}
W20260811 06:49:09.811244 16577 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48360
W20260811 06:49:09.811869 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16375: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:49:09.812014 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 16375
I20260811 06:49:09.844197 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15738
I20260811 06:49:09.845438 15870 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:09.961055 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 15738
2026-08-11T06:49:09Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9163 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:49:10 dist-test-slave-7lbf krb5kdc[16875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:49:10 dist-test-slave-7lbf krb5kdc[16875](info): set up 2 sockets
Aug 11 06:49:10 dist-test-slave-7lbf krb5kdc[16875](info): commencing operation
krb5kdc: starting...
W20260811 06:49:11.184552 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.005s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:49:11 dist-test-slave-7lbf krb5kdc[16875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430951, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:49:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:49:11.389081 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43181
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:34777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:43181
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:11.714879 16893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:11.715170 16893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:11.715257 16893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:11.722368 16893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:11.722486 16893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:11.722534 16893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:11.722589 16893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:11.722636 16893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:11.732434 16893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:34777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:43181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:11.733767 16893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:11.735072 16893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:11.746872 16900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:11.746915 16904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:11.746887 16899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:11.747713 16893 server_base.cc:1034] running on GCE node
I20260811 06:49:11.748447 16893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:11.749882 16893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:11.751089 16893 hybrid_clock.cc:648] HybridClock initialized: now 1786430951751036 us; error 44 us; skew 500 ppm
I20260811 06:49:11.751427 16893 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:11 dist-test-slave-7lbf krb5kdc[16875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430951, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:11.754514 16893 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:49:11.756003 16893 webserver.cc:460] Webserver started at http://127.12.145.62:34729/ using document root <none> and password file <none>
I20260811 06:49:11.756685 16893 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:11.756803 16893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:11.757117 16893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:11.760172 16893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "7eceff3f79054db9a1dfac8e1e4a09d3"
format_stamp: "Formatted at 2026-08-11 06:49:11 on dist-test-slave-7lbf"
server_key: "9e3dcfe33b34904c8598109a199ce6e5"
server_key_iv: "54a47b1a06ddcd3196ee6ec4f408968f"
server_key_version: "encryptionkey@0"
I20260811 06:49:11.760922 16893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "7eceff3f79054db9a1dfac8e1e4a09d3"
format_stamp: "Formatted at 2026-08-11 06:49:11 on dist-test-slave-7lbf"
server_key: "9e3dcfe33b34904c8598109a199ce6e5"
server_key_iv: "54a47b1a06ddcd3196ee6ec4f408968f"
server_key_version: "encryptionkey@0"
I20260811 06:49:11.766328 16893 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 06:49:11.769873 16914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:11.771201 16893 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:49:11.771364 16893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "7eceff3f79054db9a1dfac8e1e4a09d3"
format_stamp: "Formatted at 2026-08-11 06:49:11 on dist-test-slave-7lbf"
server_key: "9e3dcfe33b34904c8598109a199ce6e5"
server_key_iv: "54a47b1a06ddcd3196ee6ec4f408968f"
server_key_version: "encryptionkey@0"
I20260811 06:49:11.771556 16893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:11.797133 16893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:11.801285 16893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:11.801596 16893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:11.819116 16893 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:43181
I20260811 06:49:11.819149 16991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:43181 every 8 connection(s)
I20260811 06:49:11.820487 16893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:11.824195 16996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:11.829083 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 16893
I20260811 06:49:11.829288 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:11.829965 12868 external_mini_cluster.cc:1428] Setting key b417e5c9111eba66afb23ab033b6cccf
I20260811 06:49:11.835050 16996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3: Bootstrap starting.
I20260811 06:49:11.838724 16996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:11.840031 16996 log.cc:824] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:11.843719 16996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3: No bootstrap required, opened a new log
Aug 11 06:49:11 dist-test-slave-7lbf krb5kdc[16875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430951, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:11.851632 16996 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eceff3f79054db9a1dfac8e1e4a09d3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43181 } }
I20260811 06:49:11.852025 16996 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:11.852141 16996 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eceff3f79054db9a1dfac8e1e4a09d3, State: Initialized, Role: FOLLOWER
I20260811 06:49:11.852890 16996 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eceff3f79054db9a1dfac8e1e4a09d3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43181 } }
I20260811 06:49:11.853153 16996 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:11.853292 16996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:11.853479 16996 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:11.853801 16999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:11.832013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59382 (local address 127.12.145.62:43181)
0811 06:49:11.832910 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:11.832922 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:11.832966 (+ 44us) server_negotiation.cc:407] Connection header received
0811 06:49:11.834710 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:11.834734 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:11.835117 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:11.835465 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:11.837324 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:11.838726 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:11.840517 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:11.841625 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:11.841770 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:11.846440 (+ 4670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:11.846448 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:11.846466 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:11.846514 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:11.849614 (+ 3100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:11.850307 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:11.850314 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:11.850321 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:11.850513 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:11.850907 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:11.850911 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:11.850913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:11.851457 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:11.851754 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:11.852199 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 06:49:11.852635 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":408,"threads_started":1}
I20260811 06:49:11.856377 16996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eceff3f79054db9a1dfac8e1e4a09d3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43181 } }
I20260811 06:49:11.856977 16996 leader_election.cc:302] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7eceff3f79054db9a1dfac8e1e4a09d3; no voters:
I20260811 06:49:11.857649 16996 leader_election.cc:288] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:11.857717 17002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:11.858394 17002 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [term 1 LEADER]: Becoming Leader. State: Replica: 7eceff3f79054db9a1dfac8e1e4a09d3, State: Running, Role: LEADER
I20260811 06:49:11.858956 17002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eceff3f79054db9a1dfac8e1e4a09d3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43181 } }
I20260811 06:49:11.859673 16996 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:11.861542 17003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7eceff3f79054db9a1dfac8e1e4a09d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eceff3f79054db9a1dfac8e1e4a09d3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43181 } } }
I20260811 06:49:11.861557 17004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7eceff3f79054db9a1dfac8e1e4a09d3. Latest consensus state: current_term: 1 leader_uuid: "7eceff3f79054db9a1dfac8e1e4a09d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eceff3f79054db9a1dfac8e1e4a09d3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43181 } } }
I20260811 06:49:11.861951 17003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:11.861951 17004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:11.867930 17010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:11.873679 17010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:11.882781 17010 catalog_manager.cc:1347] Generated new cluster ID: 0d360381755e4d7091b4a4de74e59efb
I20260811 06:49:11.882911 17010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:11.908349 17010 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:11.909804 17010 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:11.919425 17010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7eceff3f79054db9a1dfac8e1e4a09d3: Generated new TSK 0
I20260811 06:49:11.920303 17010 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:49:11.973757 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43181
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:34777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:12.302260 17038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:12.302573 17038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:12.302716 17038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:12.310081 17038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:12.310194 17038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:12.310313 17038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:49:12.320175 17038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:34777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:12.321455 17038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:12.322791 17038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:12.335389 17049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:12.335464 17046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:12.335855 17047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:12.336112 17038 server_base.cc:1034] running on GCE node
I20260811 06:49:12.336701 17038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:12.337657 17038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:12.338855 17038 hybrid_clock.cc:648] HybridClock initialized: now 1786430952338806 us; error 42 us; skew 500 ppm
I20260811 06:49:12.339169 17038 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:12 dist-test-slave-7lbf krb5kdc[16875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430952, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:12.342456 17038 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:49:12.343946 17038 webserver.cc:460] Webserver started at http://127.12.145.1:37229/ using document root <none> and password file <none>
I20260811 06:49:12.344617 17038 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:12.344728 17038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:12.345036 17038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:12.347965 17038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "2c75bab911094d3a8ecf6809c8b5570f"
format_stamp: "Formatted at 2026-08-11 06:49:12 on dist-test-slave-7lbf"
server_key: "70937f198ee8ef8757eb4ebfe691d5ba"
server_key_iv: "7ec3e8d544f84eb55b81ec3bd3f7c1f7"
server_key_version: "encryptionkey@0"
I20260811 06:49:12.348734 17038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "2c75bab911094d3a8ecf6809c8b5570f"
format_stamp: "Formatted at 2026-08-11 06:49:12 on dist-test-slave-7lbf"
server_key: "70937f198ee8ef8757eb4ebfe691d5ba"
server_key_iv: "7ec3e8d544f84eb55b81ec3bd3f7c1f7"
server_key_version: "encryptionkey@0"
I20260811 06:49:12.353960 17038 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260811 06:49:12.357573 17057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:12.358877 17038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:12.359038 17038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "2c75bab911094d3a8ecf6809c8b5570f"
format_stamp: "Formatted at 2026-08-11 06:49:12 on dist-test-slave-7lbf"
server_key: "70937f198ee8ef8757eb4ebfe691d5ba"
server_key_iv: "7ec3e8d544f84eb55b81ec3bd3f7c1f7"
server_key_version: "encryptionkey@0"
I20260811 06:49:12.359234 17038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:12.379457 17038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:12.383570 17038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:12.383841 17038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:12.384831 17038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:12.386286 17038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:12.386360 17038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:12.386482 17038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:12.386531 17038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:12.417732 17038 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:41691
I20260811 06:49:12.417780 17255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:41691 every 8 connection(s)
I20260811 06:49:12.419032 17038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:49:12.425122 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17038
I20260811 06:49:12.425308 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:49:12.425977 12868 external_mini_cluster.cc:1428] Setting key 5ab95533a4c2c5ad7dc16495ccbbff90
Aug 11 06:49:12 dist-test-slave-7lbf krb5kdc[16875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430952, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:12.438966 17258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:12.421655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:34281 (local address 127.12.145.62:43181)
0811 06:49:12.422103 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:12.422107 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:12.422951 (+ 844us) server_negotiation.cc:407] Connection header received
0811 06:49:12.424753 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:12.424758 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:12.424848 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:12.424943 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:12.426583 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:12.427438 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:12.429184 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:12.429817 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:12.429950 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:12.433227 (+ 3277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:12.433233 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:12.433237 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:12.433276 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:12.435943 (+ 2667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:12.436774 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:12.436777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:12.436780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:12.436887 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:12.437302 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:12.437305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:12.437307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:12.437591 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:12.437712 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:12.438540 (+ 828us) server_negotiation.cc:299] Negotiation successful
0811 06:49:12.438706 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":243,"threads_started":1}
I20260811 06:49:12.440407 17259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:12.422107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43181 (local address 127.12.145.1:34281)
0811 06:49:12.422785 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:12.422832 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:12.424484 (+ 1652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:12.425191 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:12.425199 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:12.425804 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:12.426405 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:12.426424 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:12.427682 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:12.427687 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:12.429024 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:12.429037 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:12.430034 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:12.430039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:12.430233 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:12.430873 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:12.430901 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:12.433007 (+ 2106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:12.436093 (+ 3086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:12.436102 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:12.436118 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:12.436677 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:12.436974 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:12.436979 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:12.436983 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:12.437217 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:12.437705 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:12.437713 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:12.438126 (+ 413us) client_negotiation.cc:769] Sending connection context
0811 06:49:12.438481 (+ 355us) client_negotiation.cc:240] Negotiation successful
0811 06:49:12.438997 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":262,"threads_started":1}
I20260811 06:49:12.442004 17256 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43181
I20260811 06:49:12.442288 17256 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:12.443032 17256 heartbeater.cc:511] Master 127.12.145.62:43181 requested a full tablet report, sending...
I20260811 06:49:12.445498 16941 ts_manager.cc:194] Registered new tserver with Master: 2c75bab911094d3a8ecf6809c8b5570f (127.12.145.1:41691)
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
I20260811 06:49:12.447566 16941 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:34281
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:49:12.474351 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43181
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:34777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:12.798301 17264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:12.798580 17264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:12.798717 17264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:12.806072 17264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:12.806190 17264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:12.806355 17264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:49:12.816167 17264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:34777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:12.817447 17264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:12.818975 17264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:12.833429 17275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:12.833757 17272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:12.833549 17270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:12.834705 17264 server_base.cc:1034] running on GCE node
I20260811 06:49:12.835280 17264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:12.836207 17264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:12.837405 17264 hybrid_clock.cc:648] HybridClock initialized: now 1786430952837349 us; error 48 us; skew 500 ppm
I20260811 06:49:12.837726 17264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:12 dist-test-slave-7lbf krb5kdc[16875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430952, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:12.840673 17264 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:49:12.842147 17264 webserver.cc:460] Webserver started at http://127.12.145.2:37131/ using document root <none> and password file <none>
I20260811 06:49:12.842804 17264 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:12.842927 17264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:12.843228 17264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:12.846136 17264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "ddecd395da2a456db339d71c3395425d"
format_stamp: "Formatted at 2026-08-11 06:49:12 on dist-test-slave-7lbf"
server_key: "ec07dbba0dba889ed2134820e2e613d3"
server_key_iv: "63a86bb8522ec86a9be6edaccdb3364b"
server_key_version: "encryptionkey@0"
I20260811 06:49:12.846889 17264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "ddecd395da2a456db339d71c3395425d"
format_stamp: "Formatted at 2026-08-11 06:49:12 on dist-test-slave-7lbf"
server_key: "ec07dbba0dba889ed2134820e2e613d3"
server_key_iv: "63a86bb8522ec86a9be6edaccdb3364b"
server_key_version: "encryptionkey@0"
I20260811 06:49:12.852049 17264 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 06:49:12.855494 17287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:12.856740 17264 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:49:12.856889 17264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "ddecd395da2a456db339d71c3395425d"
format_stamp: "Formatted at 2026-08-11 06:49:12 on dist-test-slave-7lbf"
server_key: "ec07dbba0dba889ed2134820e2e613d3"
server_key_iv: "63a86bb8522ec86a9be6edaccdb3364b"
server_key_version: "encryptionkey@0"
I20260811 06:49:12.857091 17264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:12.871186 17264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:12.875340 17264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:12.875618 17264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:12.876624 17264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:12.878000 17264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:12.878080 17264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:12.878209 17264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:12.878270 17264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:12.909040 17264 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:38985
I20260811 06:49:12.909076 17470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:38985 every 8 connection(s)
I20260811 06:49:12.910422 17264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:49:12.912658 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17264
I20260811 06:49:12.912820 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:49:12.913371 12868 external_mini_cluster.cc:1428] Setting key c62df1902790a2b4f839620ac8cc39f9
Aug 11 06:49:12 dist-test-slave-7lbf krb5kdc[16875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430952, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:12.930239 17258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:12.913021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:43081 (local address 127.12.145.62:43181)
0811 06:49:12.913247 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:12.913253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:12.914521 (+ 1268us) server_negotiation.cc:407] Connection header received
0811 06:49:12.916388 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:12.916394 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:12.916489 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:12.916596 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:12.918111 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:12.919073 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:12.920751 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:12.921302 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:12.921424 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:12.924797 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:12.924802 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:12.924805 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:12.924839 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:12.927249 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:12.927956 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:12.927960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:12.927962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:12.928090 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:12.928519 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:12.928523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:12.928525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:12.928787 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:12.928943 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:12.929665 (+ 722us) server_negotiation.cc:299] Negotiation successful
0811 06:49:12.929909 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 06:49:12.931326 17481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:12.913547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43181 (local address 127.12.145.2:43081)
0811 06:49:12.914365 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:12.914414 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:12.916112 (+ 1698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:12.916777 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:12.916785 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:12.917316 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:12.917942 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:12.917961 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:12.919223 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:12.919227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:12.920616 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:12.920629 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:12.921510 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:12.921545 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:12.921761 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:12.922417 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:12.922441 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:12.924573 (+ 2132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:12.927393 (+ 2820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:12.927402 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:12.927419 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:12.927834 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:12.928196 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:12.928201 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:12.928205 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:12.928406 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:12.928926 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:12.928933 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:12.929273 (+ 340us) client_negotiation.cc:769] Sending connection context
0811 06:49:12.929529 (+ 256us) client_negotiation.cc:240] Negotiation successful
0811 06:49:12.930055 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":311,"threads_started":1}
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
I20260811 06:49:12.932750 17473 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43181
I20260811 06:49:12.933075 17473 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:12.933881 17473 heartbeater.cc:511] Master 127.12.145.62:43181 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
I20260811 06:49:12.935417 16941 ts_manager.cc:194] Registered new tserver with Master: ddecd395da2a456db339d71c3395425d (127.12.145.2:38985)
I20260811 06:49:12.936261 16941 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:43081
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:49:12.958611 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43181
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:34777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:13.284729 17484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:13.285035 17484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:13.285161 17484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:13.292493 17484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:13.292611 17484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:13.292759 17484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:49:13.302685 17484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:34777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:13.304066 17484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:13.305439 17484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:13.318540 17490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:13.318598 17498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:13.318651 17493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:13.319819 17484 server_base.cc:1034] running on GCE node
I20260811 06:49:13.320482 17484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:13.321494 17484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:13.322728 17484 hybrid_clock.cc:648] HybridClock initialized: now 1786430953322667 us; error 58 us; skew 500 ppm
I20260811 06:49:13.323060 17484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:13 dist-test-slave-7lbf krb5kdc[16875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430953, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:13.326241 17484 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:49:13.327708 17484 webserver.cc:460] Webserver started at http://127.12.145.3:34407/ using document root <none> and password file <none>
I20260811 06:49:13.328408 17484 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:13.328512 17484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:13.328788 17484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:13.332005 17484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "8e427d13679443229b5ca81a48d14cec"
format_stamp: "Formatted at 2026-08-11 06:49:13 on dist-test-slave-7lbf"
server_key: "5c74acdc092bf1bc8a2a545c33118536"
server_key_iv: "d2b23330f6a195877ee8565f89860297"
server_key_version: "encryptionkey@0"
I20260811 06:49:13.332794 17484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "8e427d13679443229b5ca81a48d14cec"
format_stamp: "Formatted at 2026-08-11 06:49:13 on dist-test-slave-7lbf"
server_key: "5c74acdc092bf1bc8a2a545c33118536"
server_key_iv: "d2b23330f6a195877ee8565f89860297"
server_key_version: "encryptionkey@0"
I20260811 06:49:13.338205 17484 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260811 06:49:13.342233 17507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:13.343626 17484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:13.343786 17484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "8e427d13679443229b5ca81a48d14cec"
format_stamp: "Formatted at 2026-08-11 06:49:13 on dist-test-slave-7lbf"
server_key: "5c74acdc092bf1bc8a2a545c33118536"
server_key_iv: "d2b23330f6a195877ee8565f89860297"
server_key_version: "encryptionkey@0"
I20260811 06:49:13.344005 17484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:13.357818 17484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:13.361932 17484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:13.362182 17484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:13.363215 17484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:13.364647 17484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:13.364724 17484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:13.364816 17484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:13.364866 17484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:13.395673 17484 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:42707
I20260811 06:49:13.395705 17682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:42707 every 8 connection(s)
I20260811 06:49:13.397038 17484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:49:13.399537 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17484
I20260811 06:49:13.399718 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:49:13.400285 12868 external_mini_cluster.cc:1428] Setting key 765e86f62301db96a0007e76193baf1c
Aug 11 06:49:13 dist-test-slave-7lbf krb5kdc[16875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430953, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:13.417773 17258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:13.399833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:42035 (local address 127.12.145.62:43181)
0811 06:49:13.400019 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:13.400023 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:13.401638 (+ 1615us) server_negotiation.cc:407] Connection header received
0811 06:49:13.403996 (+ 2358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:13.404000 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:13.404068 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:13.404148 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:13.405615 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:13.406362 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:13.407920 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:13.408305 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:13.408392 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:13.411800 (+ 3408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:13.411805 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:13.411809 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:13.411843 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:13.414659 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:13.415395 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:13.415400 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:13.415402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:13.415553 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:13.415995 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:13.415999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:13.416001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:13.416272 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:13.416407 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:13.417146 (+ 739us) server_negotiation.cc:299] Negotiation successful
0811 06:49:13.417378 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 06:49:13.418756 17686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:13.400476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43181 (local address 127.12.145.3:42035)
0811 06:49:13.401438 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:13.401503 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:13.403735 (+ 2232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:13.404339 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:13.404350 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:13.404890 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:13.405459 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:13.405478 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:13.406506 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:13.406511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:13.407801 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:13.407814 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:13.408476 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:13.408480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:13.408676 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:13.409322 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:13.409346 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:13.411590 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:13.414800 (+ 3210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:13.414810 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:13.414827 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:13.415266 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:13.415664 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:13.415669 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:13.415674 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:13.415877 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:13.416404 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:13.416412 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:13.416764 (+ 352us) client_negotiation.cc:769] Sending connection context
0811 06:49:13.417016 (+ 252us) client_negotiation.cc:240] Negotiation successful
0811 06:49:13.417631 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":378,"threads_started":1}
I20260811 06:49:13.420157 17684 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43181
I20260811 06:49:13.420436 17684 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:13.421206 17684 heartbeater.cc:511] Master 127.12.145.62:43181 requested a full tablet report, sending...
I20260811 06:49:13.422691 16941 ts_manager.cc:194] Registered new tserver with Master: 8e427d13679443229b5ca81a48d14cec (127.12.145.3:42707)
I20260811 06:49:13.423477 16941 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:42035
I20260811 06:49:13.428054 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:49:13.450707 17256 heartbeater.cc:503] Master 127.12.145.62:43181 was elected leader, sending a full tablet report...
W20260811 06:49:13.464720 17258 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:49:13.462201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59398 (local address 127.12.145.62:43181)
0811 06:49:13.462366 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:13.462371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:13.462753 (+ 382us) server_negotiation.cc:407] Connection header received
0811 06:49:13.462934 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:13.462938 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:13.463008 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:13.463105 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:13.464494 (+ 1389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59398: BlockingRecv error: recv got EOF from 127.0.0.1:59398 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 06:49:13.467854 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17038
W20260811 06:49:13.470592 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17038: Not authorized: Client connection negotiation failed: client connection to 127.12.145.1:41691: server requires authentication, but client does not have Kerberos credentials available
I20260811 06:49:13.470762 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17038
I20260811 06:49:13.498308 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17264
W20260811 06:49:13.500958 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17264: Not authorized: Client connection negotiation failed: client connection to 127.12.145.2:38985: server requires authentication, but client does not have Kerberos credentials available
I20260811 06:49:13.501106 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17264
I20260811 06:49:13.521229 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17484
W20260811 06:49:13.524135 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17484: Not authorized: Client connection negotiation failed: client connection to 127.12.145.3:42707: server requires authentication, but client does not have Kerberos credentials available
I20260811 06:49:13.524304 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17484
I20260811 06:49:13.549705 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16893
I20260811 06:49:13.551029 16984 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:13.654953 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 16893
2026-08-11T06:49:13Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3691 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:49:13 dist-test-slave-7lbf krb5kdc[17714](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:49:13 dist-test-slave-7lbf krb5kdc[17714](info): set up 2 sockets
Aug 11 06:49:13 dist-test-slave-7lbf krb5kdc[17714](info): commencing operation
krb5kdc: starting...
W20260811 06:49:14.905220 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.003s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:49:15 dist-test-slave-7lbf krb5kdc[17714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430955, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:49:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:49:15.105038 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:34705
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:34705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:15.431843 17736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:15.432156 17736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:15.432292 17736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:15.439518 17736 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:15.439628 17736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:15.439700 17736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:15.439776 17736 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:15.439836 17736 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:15.449656 17736 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:34705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:34705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:15.451011 17736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:15.452345 17736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:15.464438 17742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:15.464411 17743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:15.464504 17748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:15.465240 17736 server_base.cc:1034] running on GCE node
I20260811 06:49:15.466020 17736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:15.467392 17736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:15.468590 17736 hybrid_clock.cc:648] HybridClock initialized: now 1786430955468552 us; error 38 us; skew 500 ppm
I20260811 06:49:15.468899 17736 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:15 dist-test-slave-7lbf krb5kdc[17714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430955, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:15.475450 17736 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:49:15.477041 17736 webserver.cc:460] Webserver started at http://127.12.145.62:36953/ using document root <none> and password file <none>
I20260811 06:49:15.477777 17736 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:15.477885 17736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:15.478174 17736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:15.481130 17736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "116fb861d01b4fe395ea6610a4bf531d"
format_stamp: "Formatted at 2026-08-11 06:49:15 on dist-test-slave-7lbf"
server_key: "38aeb88b21bc548442d54b03a44cd5f8"
server_key_iv: "6e307c5aaca58bfb9d3703f6b0f11577"
server_key_version: "encryptionkey@0"
I20260811 06:49:15.481921 17736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "116fb861d01b4fe395ea6610a4bf531d"
format_stamp: "Formatted at 2026-08-11 06:49:15 on dist-test-slave-7lbf"
server_key: "38aeb88b21bc548442d54b03a44cd5f8"
server_key_iv: "6e307c5aaca58bfb9d3703f6b0f11577"
server_key_version: "encryptionkey@0"
I20260811 06:49:15.487093 17736 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 06:49:15.490459 17761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:15.491734 17736 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:49:15.491884 17736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "116fb861d01b4fe395ea6610a4bf531d"
format_stamp: "Formatted at 2026-08-11 06:49:15 on dist-test-slave-7lbf"
server_key: "38aeb88b21bc548442d54b03a44cd5f8"
server_key_iv: "6e307c5aaca58bfb9d3703f6b0f11577"
server_key_version: "encryptionkey@0"
I20260811 06:49:15.492059 17736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:15.514796 17736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:15.518859 17736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:15.519119 17736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:15.536504 17736 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:34705
I20260811 06:49:15.536535 17849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:34705 every 8 connection(s)
I20260811 06:49:15.537830 17736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:15.541496 17851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:15.545620 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17736
I20260811 06:49:15.545886 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:15.546659 12868 external_mini_cluster.cc:1428] Setting key 128492a10b967eae68ff61298e66ffd2
I20260811 06:49:15.553366 17851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d: Bootstrap starting.
I20260811 06:49:15.557010 17851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:15.558208 17851 log.cc:824] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:15.561600 17851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d: No bootstrap required, opened a new log
Aug 11 06:49:15 dist-test-slave-7lbf krb5kdc[17714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430955, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:15.571537 17858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:15.548630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60544 (local address 127.12.145.62:34705)
0811 06:49:15.549450 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:15.549461 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:15.549503 (+ 42us) server_negotiation.cc:407] Connection header received
0811 06:49:15.551765 (+ 2262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:15.551788 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:15.552173 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:15.552494 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:15.554388 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:15.555751 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:15.557440 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:15.558139 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:15.558269 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:15.562732 (+ 4463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:15.562743 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:15.562763 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:15.562808 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:15.566752 (+ 3944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:15.567493 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:15.567502 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:15.567516 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:15.567743 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:15.568093 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:15.568098 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:15.568101 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:15.568874 (+ 773us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:15.569175 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:15.569585 (+ 410us) server_negotiation.cc:299] Negotiation successful
0811 06:49:15.570087 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":376,"threads_started":1}
I20260811 06:49:15.572080 17851 raft_consensus.cc:348] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "116fb861d01b4fe395ea6610a4bf531d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34705 } }
I20260811 06:49:15.572434 17851 raft_consensus.cc:374] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:15.572547 17851 raft_consensus.cc:729] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116fb861d01b4fe395ea6610a4bf531d, State: Initialized, Role: FOLLOWER
I20260811 06:49:15.573098 17851 consensus_queue.cc:260] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "116fb861d01b4fe395ea6610a4bf531d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34705 } }
I20260811 06:49:15.573328 17851 raft_consensus.cc:388] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:15.573465 17851 raft_consensus.cc:482] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:15.573668 17851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:15.575398 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:49:15.576220 17851 raft_consensus.cc:504] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "116fb861d01b4fe395ea6610a4bf531d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34705 } }
I20260811 06:49:15.576695 17851 leader_election.cc:302] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 116fb861d01b4fe395ea6610a4bf531d; no voters:
I20260811 06:49:15.577287 17851 leader_election.cc:288] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:15.577406 17861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:15.579635 17851 sys_catalog.cc:564] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:15.584249 17861 raft_consensus.cc:686] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [term 1 LEADER]: Becoming Leader. State: Replica: 116fb861d01b4fe395ea6610a4bf531d, State: Running, Role: LEADER
I20260811 06:49:15.584906 17861 consensus_queue.cc:237] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "116fb861d01b4fe395ea6610a4bf531d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34705 } }
I20260811 06:49:15.588456 17863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 116fb861d01b4fe395ea6610a4bf531d. Latest consensus state: current_term: 1 leader_uuid: "116fb861d01b4fe395ea6610a4bf531d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "116fb861d01b4fe395ea6610a4bf531d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34705 } } }
I20260811 06:49:15.588928 17863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:15.588438 17862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "116fb861d01b4fe395ea6610a4bf531d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "116fb861d01b4fe395ea6610a4bf531d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34705 } } }
I20260811 06:49:15.589145 17862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:15.595527 17880 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:15.600863 17880 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:15.610816 17880 catalog_manager.cc:1347] Generated new cluster ID: 1e11f4578cd04e238e8778d0a380939e
I20260811 06:49:15.610931 17880 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:15.629540 17858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:15.620162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60546 (local address 127.12.145.62:34705)
0811 06:49:15.620350 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:15.620356 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:15.620946 (+ 590us) server_negotiation.cc:407] Connection header received
0811 06:49:15.621141 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:15.621147 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:15.621228 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:15.621327 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:15.622611 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:15.623716 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:15.625630 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:15.626242 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:15.626361 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:15.627603 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:15.627610 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:15.627614 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:15.628660 (+ 1046us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:15.628745 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:15.628780 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:15.628876 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:15.629046 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 06:49:15.629146 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 06:49:15.646445 17880 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:15.648536 17880 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:15.658864 17880 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 116fb861d01b4fe395ea6610a4bf531d: Generated new TSK 0
I20260811 06:49:15.659700 17880 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:49:15.669113 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17736
I20260811 06:49:15.670603 17842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:15.765662 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17736
2026-08-11T06:49:15Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2105 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:49:15 dist-test-slave-7lbf krb5kdc[17905](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:49:15 dist-test-slave-7lbf krb5kdc[17905](info): set up 2 sockets
Aug 11 06:49:15 dist-test-slave-7lbf krb5kdc[17905](info): commencing operation
krb5kdc: starting...
W20260811 06:49:17.013216 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.002s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:49:17 dist-test-slave-7lbf krb5kdc[17905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:49:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:49:17.223356 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:45631
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:45631
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:17.551083 17925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:17.551400 17925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:17.551537 17925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:17.558892 17925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:17.559023 17925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:17.559098 17925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:17.559183 17925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:17.559243 17925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:17.569365 17925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:45631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:45631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:17.570843 17925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:17.572183 17925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:17.583856 17930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:17.583894 17934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:17.583822 17932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:17.584667 17925 server_base.cc:1034] running on GCE node
I20260811 06:49:17.585459 17925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:17.586915 17925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:17.588120 17925 hybrid_clock.cc:648] HybridClock initialized: now 1786430957588076 us; error 41 us; skew 500 ppm
I20260811 06:49:17.588462 17925 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:17 dist-test-slave-7lbf krb5kdc[17905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430957, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:17.591564 17925 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:49:17.593151 17925 webserver.cc:460] Webserver started at http://127.12.145.62:45969/ using document root <none> and password file <none>
I20260811 06:49:17.593897 17925 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:17.594031 17925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:17.594349 17925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:17.597443 17925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "b87c05fca8de410788512aa244ce9dde"
format_stamp: "Formatted at 2026-08-11 06:49:17 on dist-test-slave-7lbf"
server_key: "ee5db0127a5a044e8968ae6b8965072f"
server_key_iv: "86899376dcc02da07b142ac4b021a6be"
server_key_version: "encryptionkey@0"
I20260811 06:49:17.598294 17925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "b87c05fca8de410788512aa244ce9dde"
format_stamp: "Formatted at 2026-08-11 06:49:17 on dist-test-slave-7lbf"
server_key: "ee5db0127a5a044e8968ae6b8965072f"
server_key_iv: "86899376dcc02da07b142ac4b021a6be"
server_key_version: "encryptionkey@0"
I20260811 06:49:17.603718 17925 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:49:17.607221 17946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:17.608548 17925 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:49:17.608728 17925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "b87c05fca8de410788512aa244ce9dde"
format_stamp: "Formatted at 2026-08-11 06:49:17 on dist-test-slave-7lbf"
server_key: "ee5db0127a5a044e8968ae6b8965072f"
server_key_iv: "86899376dcc02da07b142ac4b021a6be"
server_key_version: "encryptionkey@0"
I20260811 06:49:17.608911 17925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:17.624939 17925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:17.629161 17925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:17.629451 17925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:17.648113 17925 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:45631
I20260811 06:49:17.648136 18037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:45631 every 8 connection(s)
I20260811 06:49:17.649631 17925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:17.653700 18038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:17.654457 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17925
I20260811 06:49:17.654693 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:17.655308 12868 external_mini_cluster.cc:1428] Setting key c4779a3850702e64a3428441a34f2d05
I20260811 06:49:17.668468 18038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde: Bootstrap starting.
Aug 11 06:49:17 dist-test-slave-7lbf krb5kdc[17905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:17.672781 18038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:17.674193 18038 log.cc:824] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:17.677964 18038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde: No bootstrap required, opened a new log
I20260811 06:49:17.680154 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:17.657347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49626 (local address 127.12.145.62:45631)
0811 06:49:17.658158 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:17.658170 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:17.658213 (+ 43us) server_negotiation.cc:407] Connection header received
0811 06:49:17.660070 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:17.660096 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:17.660523 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:17.660871 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:17.662909 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:17.664234 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:17.666178 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:17.666873 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:17.667030 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:17.672186 (+ 5156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:17.672195 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:17.672212 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:17.672258 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:17.675892 (+ 3634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:17.676812 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:17.676819 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:17.676826 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:17.676998 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:17.677463 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:17.677466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:17.677468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:17.678033 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:17.678312 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:17.678752 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 06:49:17.679097 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":356,"threads_started":1}
I20260811 06:49:17.686414 18038 raft_consensus.cc:348] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c05fca8de410788512aa244ce9dde" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45631 } }
I20260811 06:49:17.686800 18038 raft_consensus.cc:374] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:17.686903 18038 raft_consensus.cc:729] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c05fca8de410788512aa244ce9dde, State: Initialized, Role: FOLLOWER
I20260811 06:49:17.687486 18038 consensus_queue.cc:260] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c05fca8de410788512aa244ce9dde" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45631 } }
I20260811 06:49:17.687724 18038 raft_consensus.cc:388] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:17.687865 18038 raft_consensus.cc:482] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:17.688035 18038 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:17.690707 18038 raft_consensus.cc:504] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c05fca8de410788512aa244ce9dde" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45631 } }
I20260811 06:49:17.691251 18038 leader_election.cc:302] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b87c05fca8de410788512aa244ce9dde; no voters:
I20260811 06:49:17.691844 18038 leader_election.cc:288] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:17.691962 18047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:17.692624 18047 raft_consensus.cc:686] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [term 1 LEADER]: Becoming Leader. State: Replica: b87c05fca8de410788512aa244ce9dde, State: Running, Role: LEADER
I20260811 06:49:17.693197 18047 consensus_queue.cc:237] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c05fca8de410788512aa244ce9dde" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45631 } }
I20260811 06:49:17.694062 18038 sys_catalog.cc:564] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:17.695921 18048 sys_catalog.cc:455] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b87c05fca8de410788512aa244ce9dde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c05fca8de410788512aa244ce9dde" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45631 } } }
I20260811 06:49:17.696305 18048 sys_catalog.cc:458] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:17.697132 18058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:17.696940 18051 sys_catalog.cc:455] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [sys.catalog]: SysCatalogTable state changed. Reason: New leader b87c05fca8de410788512aa244ce9dde. Latest consensus state: current_term: 1 leader_uuid: "b87c05fca8de410788512aa244ce9dde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c05fca8de410788512aa244ce9dde" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45631 } } }
I20260811 06:49:17.697350 18051 sys_catalog.cc:458] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:17.703298 18058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:17.712855 18058 catalog_manager.cc:1347] Generated new cluster ID: b1dc932abb8147e3a1feb38ca287309b
I20260811 06:49:17.712990 18058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:17.723228 18058 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:17.725080 18058 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:17.739387 18058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b87c05fca8de410788512aa244ce9dde: Generated new TSK 0
I20260811 06:49:17.740509 18058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:49:17.797086 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45631
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:18.123960 18077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:18.124257 18077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:18.124397 18077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:18.131724 18077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:18.131858 18077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:18.132014 18077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:49:18.141782 18077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:18.143056 18077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:18.144387 18077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:18.156925 18085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:18.156828 18086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:18.156868 18088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:18.157779 18077 server_base.cc:1034] running on GCE node
I20260811 06:49:18.158382 18077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:18.159263 18077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:18.160470 18077 hybrid_clock.cc:648] HybridClock initialized: now 1786430958160410 us; error 53 us; skew 500 ppm
I20260811 06:49:18.160789 18077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:18 dist-test-slave-7lbf krb5kdc[17905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430958, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:18.163859 18077 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:49:18.165220 18077 webserver.cc:460] Webserver started at http://127.12.145.1:37801/ using document root <none> and password file <none>
I20260811 06:49:18.165915 18077 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:18.166031 18077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:18.166324 18077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:18.169189 18077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "b54f3263d28f4f7ba22bc9ffd5d19679"
format_stamp: "Formatted at 2026-08-11 06:49:18 on dist-test-slave-7lbf"
server_key: "3d1889dd4da22a22181a72207949ffed"
server_key_iv: "774d394d3ad6ae6cb2a15b9dd6294045"
server_key_version: "encryptionkey@0"
I20260811 06:49:18.170027 18077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "b54f3263d28f4f7ba22bc9ffd5d19679"
format_stamp: "Formatted at 2026-08-11 06:49:18 on dist-test-slave-7lbf"
server_key: "3d1889dd4da22a22181a72207949ffed"
server_key_iv: "774d394d3ad6ae6cb2a15b9dd6294045"
server_key_version: "encryptionkey@0"
I20260811 06:49:18.174875 18077 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 06:49:18.178154 18098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:18.179476 18077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:18.179636 18077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "b54f3263d28f4f7ba22bc9ffd5d19679"
format_stamp: "Formatted at 2026-08-11 06:49:18 on dist-test-slave-7lbf"
server_key: "3d1889dd4da22a22181a72207949ffed"
server_key_iv: "774d394d3ad6ae6cb2a15b9dd6294045"
server_key_version: "encryptionkey@0"
I20260811 06:49:18.179811 18077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:18.191695 18077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:18.195741 18077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:18.195981 18077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:18.196832 18077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:18.198242 18077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:18.198324 18077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:18.198415 18077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:18.198457 18077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:18.229198 18077 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:38301
I20260811 06:49:18.229235 18297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:38301 every 8 connection(s)
I20260811 06:49:18.230521 18077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:49:18.238088 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 18077
I20260811 06:49:18.238318 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:49:18.238963 12868 external_mini_cluster.cc:1428] Setting key 1732a3f7678800083230580a5363d5c7
Aug 11 06:49:18 dist-test-slave-7lbf krb5kdc[17905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430958, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:18.250428 18303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:18.233097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:41235 (local address 127.12.145.62:45631)
0811 06:49:18.233589 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:18.233594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:18.234418 (+ 824us) server_negotiation.cc:407] Connection header received
0811 06:49:18.236215 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:18.236221 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:18.236300 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:18.236396 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:18.238093 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:18.239043 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:18.240729 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:18.241129 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:18.241240 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:18.244894 (+ 3654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:18.244900 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:18.244903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:18.244938 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:18.247313 (+ 2375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:18.248133 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:18.248139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:18.248143 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:18.248295 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:18.248673 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:18.248678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:18.248681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:18.249025 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:18.249174 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:18.249845 (+ 671us) server_negotiation.cc:299] Negotiation successful
0811 06:49:18.250070 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":240,"threads_started":1}
I20260811 06:49:18.251199 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:18.233551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:45631 (local address 127.12.145.1:41235)
0811 06:49:18.234257 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:18.234303 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:18.235929 (+ 1626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:18.236657 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:18.236666 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:18.237197 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:18.237882 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:18.237910 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:18.239202 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:18.239207 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:18.240576 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:18.240594 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:18.241347 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:18.241355 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:18.241610 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:18.242272 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:18.242296 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:18.244649 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:18.247451 (+ 2802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:18.247460 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:18.247477 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:18.248014 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:18.248394 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:18.248397 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:18.248399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:18.248574 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:18.249134 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:18.249139 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:18.249448 (+ 309us) client_negotiation.cc:769] Sending connection context
0811 06:49:18.249713 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 06:49:18.250104 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":263,"threads_started":1}
I20260811 06:49:18.252722 18299 heartbeater.cc:347] Connected to a master server at 127.12.145.62:45631
I20260811 06:49:18.253037 18299 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:18.253785 18299 heartbeater.cc:511] Master 127.12.145.62:45631 requested a full tablet report, sending...
I20260811 06:49:18.256814 17976 ts_manager.cc:194] Registered new tserver with Master: b54f3263d28f4f7ba22bc9ffd5d19679 (127.12.145.1:38301)
I20260811 06:49:18.258361 17976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:41235
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:49:18.286873 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45631
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:18.614809 18310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:18.615135 18310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:18.615278 18310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:18.622462 18310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:18.622592 18310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:18.622751 18310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:49:18.632498 18310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:18.633975 18310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:18.635295 18310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:18.648052 18320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:18.648011 18326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:18.648077 18321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:18.649565 18310 server_base.cc:1034] running on GCE node
I20260811 06:49:18.650254 18310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:18.651373 18310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:18.652616 18310 hybrid_clock.cc:648] HybridClock initialized: now 1786430958652545 us; error 55 us; skew 500 ppm
I20260811 06:49:18.652981 18310 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:18 dist-test-slave-7lbf krb5kdc[17905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430958, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:18.656349 18310 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:49:18.658066 18310 webserver.cc:460] Webserver started at http://127.12.145.2:38481/ using document root <none> and password file <none>
I20260811 06:49:18.658757 18310 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:18.658890 18310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:18.659186 18310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:18.662237 18310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "b65b874f4b0c4d85a18ca71f747b30c7"
format_stamp: "Formatted at 2026-08-11 06:49:18 on dist-test-slave-7lbf"
server_key: "d8d33f13ef7b0760999971bfdc91625c"
server_key_iv: "5171f4f174f2ea60fa31181b9a20789b"
server_key_version: "encryptionkey@0"
I20260811 06:49:18.663041 18310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "b65b874f4b0c4d85a18ca71f747b30c7"
format_stamp: "Formatted at 2026-08-11 06:49:18 on dist-test-slave-7lbf"
server_key: "d8d33f13ef7b0760999971bfdc91625c"
server_key_iv: "5171f4f174f2ea60fa31181b9a20789b"
server_key_version: "encryptionkey@0"
I20260811 06:49:18.668422 18310 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 06:49:18.672011 18336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:18.673314 18310 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:49:18.673476 18310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "b65b874f4b0c4d85a18ca71f747b30c7"
format_stamp: "Formatted at 2026-08-11 06:49:18 on dist-test-slave-7lbf"
server_key: "d8d33f13ef7b0760999971bfdc91625c"
server_key_iv: "5171f4f174f2ea60fa31181b9a20789b"
server_key_version: "encryptionkey@0"
I20260811 06:49:18.673708 18310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:18.695070 18310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:18.699503 18310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:18.699815 18310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:18.700826 18310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:18.702251 18310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:18.702333 18310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:18.702454 18310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:18.702510 18310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:18.733559 18310 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:44619
I20260811 06:49:18.733644 18531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:44619 every 8 connection(s)
I20260811 06:49:18.734929 18310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:49:18.737807 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 18310
I20260811 06:49:18.738003 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:49:18.738487 12868 external_mini_cluster.cc:1428] Setting key f2f91539c5512d4ab3b35b95f6bb4876
Aug 11 06:49:18 dist-test-slave-7lbf krb5kdc[17905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430958, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:18.757706 18303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:18.737547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:36917 (local address 127.12.145.62:45631)
0811 06:49:18.737748 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:18.737754 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:18.739852 (+ 2098us) server_negotiation.cc:407] Connection header received
0811 06:49:18.742243 (+ 2391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:18.742248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:18.742314 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:18.742395 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:18.744317 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:18.745005 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:18.747082 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:18.747494 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:18.747585 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:18.751202 (+ 3617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:18.751210 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:18.751215 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:18.751258 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:18.754452 (+ 3194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:18.755221 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:18.755226 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:18.755229 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:18.755382 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:18.755869 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:18.755873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:18.755876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:18.756218 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:18.756355 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:18.757106 (+ 751us) server_negotiation.cc:299] Negotiation successful
0811 06:49:18.757357 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 06:49:18.758639 18534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:18.738035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:45631 (local address 127.12.145.2:36917)
0811 06:49:18.739662 (+ 1627us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:18.739713 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:18.741955 (+ 2242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:18.742682 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:18.742695 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:18.743414 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:18.744166 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:18.744190 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:18.745165 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:18.745170 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:18.746953 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:18.746974 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:18.747704 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:18.747710 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:18.747973 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:18.748676 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:18.748708 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:18.750954 (+ 2246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:18.754618 (+ 3664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:18.754625 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:18.754640 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:18.755080 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:18.755513 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:18.755517 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:18.755519 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:18.755734 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:18.756346 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:18.756352 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:18.756691 (+ 339us) client_negotiation.cc:769] Sending connection context
0811 06:49:18.756948 (+ 257us) client_negotiation.cc:240] Negotiation successful
0811 06:49:18.757391 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1301,"thread_start_us":1076,"threads_started":1}
I20260811 06:49:18.760124 18532 heartbeater.cc:347] Connected to a master server at 127.12.145.62:45631
I20260811 06:49:18.760507 18532 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:18.761437 18532 heartbeater.cc:511] Master 127.12.145.62:45631 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
I20260811 06:49:18.763199 17976 ts_manager.cc:194] Registered new tserver with Master: b65b874f4b0c4d85a18ca71f747b30c7 (127.12.145.2:44619)
I20260811 06:49:18.764043 17976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:36917
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:49:18.790748 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45631
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:19.121223 18537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:19.121500 18537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:19.121635 18537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:19.128746 18537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:19.128861 18537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:19.128983 18537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:49:19.138753 18537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:19.140010 18537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:19.141283 18537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:19.154045 18543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:19.154084 18546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:19.154019 18544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:19.155169 18537 server_base.cc:1034] running on GCE node
I20260811 06:49:19.155750 18537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:19.156642 18537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:19.157881 18537 hybrid_clock.cc:648] HybridClock initialized: now 1786430959157796 us; error 38 us; skew 500 ppm
I20260811 06:49:19.158191 18537 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:19 dist-test-slave-7lbf krb5kdc[17905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430959, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:19.161270 18537 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:49:19.162819 18537 webserver.cc:460] Webserver started at http://127.12.145.3:37053/ using document root <none> and password file <none>
I20260811 06:49:19.163498 18537 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:19.163633 18537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:19.163959 18537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:19.167083 18537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "5dcf9dcd47a740e99d99ee988f00c655"
format_stamp: "Formatted at 2026-08-11 06:49:19 on dist-test-slave-7lbf"
server_key: "a60c3770a326fd9a3d72d8538235d001"
server_key_iv: "6009699b729a779eeb5303f8c4eaddb3"
server_key_version: "encryptionkey@0"
I20260811 06:49:19.167907 18537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "5dcf9dcd47a740e99d99ee988f00c655"
format_stamp: "Formatted at 2026-08-11 06:49:19 on dist-test-slave-7lbf"
server_key: "a60c3770a326fd9a3d72d8538235d001"
server_key_iv: "6009699b729a779eeb5303f8c4eaddb3"
server_key_version: "encryptionkey@0"
I20260811 06:49:19.173447 18537 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:49:19.177047 18557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:19.178478 18537 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:19.178639 18537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "5dcf9dcd47a740e99d99ee988f00c655"
format_stamp: "Formatted at 2026-08-11 06:49:19 on dist-test-slave-7lbf"
server_key: "a60c3770a326fd9a3d72d8538235d001"
server_key_iv: "6009699b729a779eeb5303f8c4eaddb3"
server_key_version: "encryptionkey@0"
I20260811 06:49:19.178862 18537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:19.196770 18537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:19.200780 18537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:19.201067 18537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:19.202126 18537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:19.203507 18537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:19.203588 18537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:19.203713 18537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:19.203766 18537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:19.234616 18537 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:34749
I20260811 06:49:19.234619 18751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:34749 every 8 connection(s)
I20260811 06:49:19.235873 18537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:49:19.242300 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 18537
I20260811 06:49:19.242508 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:49:19.243084 12868 external_mini_cluster.cc:1428] Setting key 8c261d5a890cd7b01758f279a81ffa2b
Aug 11 06:49:19 dist-test-slave-7lbf krb5kdc[17905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430959, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:19.255455 18303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:19.238345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:38469 (local address 127.12.145.62:45631)
0811 06:49:19.238521 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:19.238525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:19.239648 (+ 1123us) server_negotiation.cc:407] Connection header received
0811 06:49:19.241428 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:19.241434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:19.241539 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:19.241633 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:19.243686 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.244694 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.246351 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.246744 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.246843 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:19.250198 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:19.250204 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:19.250207 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:19.250241 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:19.252603 (+ 2362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:19.253285 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:19.253290 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:19.253292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:19.253441 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:19.253948 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:19.253952 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:19.253955 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:19.254247 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:19.254370 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:19.255028 (+ 658us) server_negotiation.cc:299] Negotiation successful
0811 06:49:19.255200 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 06:49:19.256428 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:19.238757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:45631 (local address 127.12.145.3:38469)
0811 06:49:19.239480 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:19.239526 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:19.241140 (+ 1614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:19.241911 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:19.241922 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:19.242672 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:19.243449 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:19.243492 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.244863 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.244868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:19.246184 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:19.246202 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.246917 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.246922 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:19.247119 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:19.247729 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:19.247752 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:19.249989 (+ 2237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:19.252727 (+ 2738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:19.252735 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:19.252747 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:19.253161 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:19.253552 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:19.253555 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:19.253558 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:19.253769 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:19.254355 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:19.254361 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:19.254689 (+ 328us) client_negotiation.cc:769] Sending connection context
0811 06:49:19.254929 (+ 240us) client_negotiation.cc:240] Negotiation successful
0811 06:49:19.255312 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":271,"threads_started":1}
I20260811 06:49:19.258141 18755 heartbeater.cc:347] Connected to a master server at 127.12.145.62:45631
I20260811 06:49:19.258524 18755 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:19.259539 18755 heartbeater.cc:511] Master 127.12.145.62:45631 requested a full tablet report, sending...
I20260811 06:49:19.261076 17973 ts_manager.cc:194] Registered new tserver with Master: 5dcf9dcd47a740e99d99ee988f00c655 (127.12.145.3:34749)
I20260811 06:49:19.261176 18299 heartbeater.cc:503] Master 127.12.145.62:45631 was elected leader, sending a full tablet report...
I20260811 06:49:19.262094 17973 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:38469
I20260811 06:49:19.271605 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 06:49:19 dist-test-slave-7lbf krb5kdc[17905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430959, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 06:49:19 dist-test-slave-7lbf krb5kdc[17905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430959, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:19.322275 18303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:19.309289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49638 (local address 127.12.145.62:45631)
0811 06:49:19.309547 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:19.309554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:19.309844 (+ 290us) server_negotiation.cc:407] Connection header received
0811 06:49:19.310021 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:19.310026 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:19.310093 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:19.310175 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:19.311489 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.312216 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.313412 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.313947 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.314039 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:19.317604 (+ 3565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:19.317609 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:19.317612 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:19.317645 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:19.319823 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:19.320424 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:19.320429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:19.320431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:19.320562 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:19.320913 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:19.320917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:19.320919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:19.321228 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:19.321461 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:19.321784 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 06:49:19.321996 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 06:49:19.322853 17973 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49638
I20260811 06:49:19.324894 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18077
Aug 11 06:49:19 dist-test-slave-7lbf krb5kdc[17905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430959, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:49:19.339744 18771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:19.325877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57422 (local address 127.12.145.1:38301)
0811 06:49:19.326510 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:19.326518 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:19.326544 (+ 26us) server_negotiation.cc:407] Connection header received
0811 06:49:19.326598 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:19.326605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:19.326827 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:19.326951 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:19.328026 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.329040 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.330239 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.330840 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.330939 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:19.334579 (+ 3640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:19.334592 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:19.334607 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:19.334649 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:19.337311 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:19.337985 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:19.337993 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:19.337995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:19.338123 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:19.338414 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:19.338419 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:19.338422 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:19.338757 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:19.338980 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:19.339182 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 06:49:19.339378 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":325,"threads_started":1}
W20260811 06:49:19.341048 18286 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57422
W20260811 06:49:19.342202 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18077: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:49:19.342399 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 18077
I20260811 06:49:19.363945 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18310
Aug 11 06:49:19 dist-test-slave-7lbf krb5kdc[17905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430959, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:49:19.379698 18772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:19.364758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42376 (local address 127.12.145.2:44619)
0811 06:49:19.365316 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:19.365322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:19.365348 (+ 26us) server_negotiation.cc:407] Connection header received
0811 06:49:19.365409 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:19.365415 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:19.365680 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:19.365813 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:19.367043 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.368051 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.369302 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.369977 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.370084 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:19.374012 (+ 3928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:19.374026 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:19.374042 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:19.374078 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:19.376805 (+ 2727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:19.377507 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:19.377533 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:19.377536 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:19.377686 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:19.378060 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:19.378066 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:19.378069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:19.378419 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:19.378715 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:19.379080 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 06:49:19.379352 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":283,"threads_started":1}
W20260811 06:49:19.381006 18524 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42376
W20260811 06:49:19.382159 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18310: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:49:19.382318 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 18310
I20260811 06:49:19.409183 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18537
Aug 11 06:49:19 dist-test-slave-7lbf krb5kdc[17905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430959, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:49:19.425586 18774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:19.410150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41856 (local address 127.12.145.3:34749)
0811 06:49:19.410722 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:19.410729 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:19.410759 (+ 30us) server_negotiation.cc:407] Connection header received
0811 06:49:19.410821 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:19.410828 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:19.411056 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:19.411205 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:19.412633 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.413901 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.415125 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:19.415682 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:19.415807 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:19.419980 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:19.419991 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:19.420007 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:19.420042 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:19.422826 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:19.423465 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:19.423473 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:19.423475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:19.423598 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:19.423956 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:19.423960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:19.423962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:19.424322 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:19.424627 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:19.424933 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 06:49:19.425215 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":258,"threads_started":1}
W20260811 06:49:19.426888 18743 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41856
W20260811 06:49:19.428121 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18537: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:49:19.428275 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 18537
I20260811 06:49:19.452409 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17925
I20260811 06:49:19.453740 18033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:19.555943 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17925
2026-08-11T06:49:19Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3793 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:49:19 dist-test-slave-7lbf krb5kdc[18780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:49:19 dist-test-slave-7lbf krb5kdc[18780](info): set up 2 sockets
Aug 11 06:49:19 dist-test-slave-7lbf krb5kdc[18780](info): commencing operation
krb5kdc: starting...
W20260811 06:49:20.782781 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:49:20 dist-test-slave-7lbf krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430960, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:49:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:49:21.005725 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:33815
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:35319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:33815
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:21.336061 18802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:21.336402 18802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:21.336548 18802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:21.343787 18802 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:21.343914 18802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:21.343994 18802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:21.344074 18802 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:21.344136 18802 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:21.354108 18802 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:35319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:33815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:33815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:21.355495 18802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:21.356824 18802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:21.368582 18813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:21.368561 18816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:21.368531 18812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:21.369627 18802 server_base.cc:1034] running on GCE node
I20260811 06:49:21.370429 18802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:21.371893 18802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:21.373133 18802 hybrid_clock.cc:648] HybridClock initialized: now 1786430961373063 us; error 47 us; skew 500 ppm
I20260811 06:49:21.373497 18802 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:21 dist-test-slave-7lbf krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430961, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:21.379690 18802 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:49:21.381302 18802 webserver.cc:460] Webserver started at http://127.12.145.62:41325/ using document root <none> and password file <none>
I20260811 06:49:21.382045 18802 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:21.382169 18802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:21.382485 18802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:21.385542 18802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "7b47a5ffce0a4864aadd97ae0056bcd9"
format_stamp: "Formatted at 2026-08-11 06:49:21 on dist-test-slave-7lbf"
server_key: "0cb35a912f11e2be46bec6524fb0cf5f"
server_key_iv: "5d7f16d31051e04370bc3ec7ca7def11"
server_key_version: "encryptionkey@0"
I20260811 06:49:21.386379 18802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "7b47a5ffce0a4864aadd97ae0056bcd9"
format_stamp: "Formatted at 2026-08-11 06:49:21 on dist-test-slave-7lbf"
server_key: "0cb35a912f11e2be46bec6524fb0cf5f"
server_key_iv: "5d7f16d31051e04370bc3ec7ca7def11"
server_key_version: "encryptionkey@0"
I20260811 06:49:21.391592 18802 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:49:21.395126 18825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:21.396575 18802 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:49:21.396749 18802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "7b47a5ffce0a4864aadd97ae0056bcd9"
format_stamp: "Formatted at 2026-08-11 06:49:21 on dist-test-slave-7lbf"
server_key: "0cb35a912f11e2be46bec6524fb0cf5f"
server_key_iv: "5d7f16d31051e04370bc3ec7ca7def11"
server_key_version: "encryptionkey@0"
I20260811 06:49:21.396939 18802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:21.420852 18802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:21.424933 18802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:21.425211 18802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:21.442747 18802 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:33815
I20260811 06:49:21.442751 18903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:33815 every 8 connection(s)
I20260811 06:49:21.444203 18802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:21.448024 18904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:21.448220 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 18802
I20260811 06:49:21.448405 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:21.449035 12868 external_mini_cluster.cc:1428] Setting key 269970bb053bc8946c94ec78659ae575
I20260811 06:49:21.460759 18904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9: Bootstrap starting.
I20260811 06:49:21.464488 18904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:21.465502 18904 log.cc:824] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9: Log is configured to *not* fsync() on all Append() calls
Aug 11 06:49:21 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430960, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:21.468647 18904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9: No bootstrap required, opened a new log
I20260811 06:49:21.475402 18908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:21.451278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53710 (local address 127.12.145.62:33815)
0811 06:49:21.452197 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:21.452214 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:21.454167 (+ 1953us) server_negotiation.cc:407] Connection header received
0811 06:49:21.456505 (+ 2338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:21.456537 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:21.457107 (+ 570us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:21.457594 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:21.458938 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:21.460936 (+ 1998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:21.462254 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:21.463316 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:21.463517 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:21.467746 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:21.467754 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:21.467769 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:21.467809 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:21.470828 (+ 3019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:21.471715 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:21.471723 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:21.471730 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:21.471954 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:21.472428 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:21.472433 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:21.472435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:21.472994 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:21.473244 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:21.473823 (+ 579us) server_negotiation.cc:299] Negotiation successful
0811 06:49:21.474272 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":387,"threads_started":1}
I20260811 06:49:21.477257 18904 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b47a5ffce0a4864aadd97ae0056bcd9" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33815 } }
I20260811 06:49:21.477644 18904 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:21.477747 18904 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b47a5ffce0a4864aadd97ae0056bcd9, State: Initialized, Role: FOLLOWER
I20260811 06:49:21.478322 18904 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b47a5ffce0a4864aadd97ae0056bcd9" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33815 } }
I20260811 06:49:21.478554 18904 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:21.478683 18904 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:21.478852 18904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:21.480960 18904 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b47a5ffce0a4864aadd97ae0056bcd9" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33815 } }
I20260811 06:49:21.481442 18904 leader_election.cc:302] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b47a5ffce0a4864aadd97ae0056bcd9; no voters:
I20260811 06:49:21.482045 18904 leader_election.cc:288] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:21.482180 18912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:21.482877 18912 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b47a5ffce0a4864aadd97ae0056bcd9, State: Running, Role: LEADER
I20260811 06:49:21.483440 18912 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b47a5ffce0a4864aadd97ae0056bcd9" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33815 } }
I20260811 06:49:21.483979 18904 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:21.486272 18914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b47a5ffce0a4864aadd97ae0056bcd9. Latest consensus state: current_term: 1 leader_uuid: "7b47a5ffce0a4864aadd97ae0056bcd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b47a5ffce0a4864aadd97ae0056bcd9" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33815 } } }
I20260811 06:49:21.486622 18914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:21.487195 18913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b47a5ffce0a4864aadd97ae0056bcd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b47a5ffce0a4864aadd97ae0056bcd9" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33815 } } }
I20260811 06:49:21.487542 18913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:21.490681 18924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:21.496114 18924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:21.505383 18924 catalog_manager.cc:1347] Generated new cluster ID: 3678039cc04f4da8a27e97bcccd8321c
I20260811 06:49:21.505550 18924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:21.527973 18924 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:21.529997 18924 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:21.547822 18924 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b47a5ffce0a4864aadd97ae0056bcd9: Generated new TSK 0
I20260811 06:49:21.549052 18924 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:49:21.607194 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33815
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:35319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:21.940598 18959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:21.940881 18959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:21.940974 18959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:21.948088 18959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:21.948191 18959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:21.948308 18959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:49:21.957892 18959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:35319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33815
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:21.959143 18959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:21.960407 18959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:21.973706 18973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:21.973680 18974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:21.973858 18976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:21.975023 18959 server_base.cc:1034] running on GCE node
I20260811 06:49:21.975628 18959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:21.976518 18959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:21.977710 18959 hybrid_clock.cc:648] HybridClock initialized: now 1786430961977656 us; error 49 us; skew 500 ppm
I20260811 06:49:21.978004 18959 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:21 dist-test-slave-7lbf krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430961, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:21.980995 18959 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:49:21.982508 18959 webserver.cc:460] Webserver started at http://127.12.145.1:46063/ using document root <none> and password file <none>
I20260811 06:49:21.983170 18959 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:21.983290 18959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:21.983601 18959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:21.986618 18959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "ffc1ee0115064484a0accd0f67b8180b"
format_stamp: "Formatted at 2026-08-11 06:49:21 on dist-test-slave-7lbf"
server_key: "cbc1062fe55bba4e7b13ec1c2aad42e3"
server_key_iv: "ad89f5ab7316561857d75a60cc58134c"
server_key_version: "encryptionkey@0"
I20260811 06:49:21.987394 18959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "ffc1ee0115064484a0accd0f67b8180b"
format_stamp: "Formatted at 2026-08-11 06:49:21 on dist-test-slave-7lbf"
server_key: "cbc1062fe55bba4e7b13ec1c2aad42e3"
server_key_iv: "ad89f5ab7316561857d75a60cc58134c"
server_key_version: "encryptionkey@0"
I20260811 06:49:21.992937 18959 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:49:21.996587 18985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:21.998109 18959 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:21.998283 18959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "ffc1ee0115064484a0accd0f67b8180b"
format_stamp: "Formatted at 2026-08-11 06:49:21 on dist-test-slave-7lbf"
server_key: "cbc1062fe55bba4e7b13ec1c2aad42e3"
server_key_iv: "ad89f5ab7316561857d75a60cc58134c"
server_key_version: "encryptionkey@0"
I20260811 06:49:21.998487 18959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:22.064179 18959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:22.068217 18959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:22.068490 18959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:22.069456 18959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:22.070878 18959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:22.070955 18959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:22.071072 18959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:22.071125 18959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:22.101893 18959 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:39475
I20260811 06:49:22.101963 19192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:39475 every 8 connection(s)
I20260811 06:49:22.103286 18959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:49:22.109946 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 18959
I20260811 06:49:22.110114 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:49:22.110731 12868 external_mini_cluster.cc:1428] Setting key e1eb2c05cf7190645139c636008768c9
Aug 11 06:49:22 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430961, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:22.122524 19196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:22.105777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:49989 (local address 127.12.145.62:33815)
0811 06:49:22.106226 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:22.106230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:22.107098 (+ 868us) server_negotiation.cc:407] Connection header received
0811 06:49:22.108870 (+ 1772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:22.108876 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:22.108958 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:22.109053 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:22.110656 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:22.111532 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:22.113187 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:22.113684 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:22.113791 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:22.117042 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:22.117048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:22.117053 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:22.117087 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:22.119533 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:22.120235 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:22.120240 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:22.120244 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:22.120378 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:22.120787 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:22.120792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:22.120795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:22.121054 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:22.121198 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:22.121924 (+ 726us) server_negotiation.cc:299] Negotiation successful
0811 06:49:22.122145 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":234,"threads_started":1}
I20260811 06:49:22.123487 19198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:22.106218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:33815 (local address 127.12.145.1:49989)
0811 06:49:22.106932 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:22.106979 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:22.108610 (+ 1631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:22.109292 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:22.109302 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:22.109867 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:22.110470 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:22.110489 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:22.111696 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:22.111699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:22.113050 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:22.113062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:22.113916 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:22.113923 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:22.114141 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:22.114745 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:22.114767 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:22.116831 (+ 2064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:22.119662 (+ 2831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:22.119671 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:22.119688 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:22.120120 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:22.120489 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:22.120494 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:22.120498 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:22.120679 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:22.121180 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:22.121188 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:22.121548 (+ 360us) client_negotiation.cc:769] Sending connection context
0811 06:49:22.121828 (+ 280us) client_negotiation.cc:240] Negotiation successful
0811 06:49:22.122365 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":266,"threads_started":1}
I20260811 06:49:22.125062 19193 heartbeater.cc:347] Connected to a master server at 127.12.145.62:33815
I20260811 06:49:22.125422 19193 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:22.126313 19193 heartbeater.cc:511] Master 127.12.145.62:33815 requested a full tablet report, sending...
I20260811 06:49:22.128844 18850 ts_manager.cc:194] Registered new tserver with Master: ffc1ee0115064484a0accd0f67b8180b (127.12.145.1:39475)
I20260811 06:49:22.130992 18850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:49989
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:49:22.158782 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33815
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:35319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:22.484447 19202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:22.484719 19202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:22.484819 19202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:22.491901 19202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:22.492004 19202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:22.492120 19202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:49:22.501688 19202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:35319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33815
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:22.502938 19202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:22.504236 19202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:22.516713 19210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:22.516688 19212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:22.516914 19208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:22.517395 19202 server_base.cc:1034] running on GCE node
I20260811 06:49:22.518011 19202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:22.518903 19202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:22.520099 19202 hybrid_clock.cc:648] HybridClock initialized: now 1786430962520040 us; error 51 us; skew 500 ppm
I20260811 06:49:22.520401 19202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:22 dist-test-slave-7lbf krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430962, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:22.523576 19202 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:49:22.524981 19202 webserver.cc:460] Webserver started at http://127.12.145.2:34943/ using document root <none> and password file <none>
I20260811 06:49:22.525701 19202 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:22.525810 19202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:22.526090 19202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:22.529027 19202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "0dae1192cb814fc595e7f155c069eacb"
format_stamp: "Formatted at 2026-08-11 06:49:22 on dist-test-slave-7lbf"
server_key: "54d75316d5be12c9e87a9b6f453c4c84"
server_key_iv: "30ae4447717b9415645b469851e7183e"
server_key_version: "encryptionkey@0"
I20260811 06:49:22.529806 19202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "0dae1192cb814fc595e7f155c069eacb"
format_stamp: "Formatted at 2026-08-11 06:49:22 on dist-test-slave-7lbf"
server_key: "54d75316d5be12c9e87a9b6f453c4c84"
server_key_iv: "30ae4447717b9415645b469851e7183e"
server_key_version: "encryptionkey@0"
I20260811 06:49:22.535107 19202 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 06:49:22.538597 19221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:22.539966 19202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:22.540107 19202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "0dae1192cb814fc595e7f155c069eacb"
format_stamp: "Formatted at 2026-08-11 06:49:22 on dist-test-slave-7lbf"
server_key: "54d75316d5be12c9e87a9b6f453c4c84"
server_key_iv: "30ae4447717b9415645b469851e7183e"
server_key_version: "encryptionkey@0"
I20260811 06:49:22.540283 19202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:22.571249 19202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:22.575578 19202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:22.575829 19202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:22.576793 19202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:22.578167 19202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:22.578244 19202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:22.578336 19202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:22.578387 19202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:22.609850 19202 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:38931
I20260811 06:49:22.609912 19430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:38931 every 8 connection(s)
I20260811 06:49:22.611205 19202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:49:22.620350 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 19202
I20260811 06:49:22.620512 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:49:22.620975 12868 external_mini_cluster.cc:1428] Setting key 7efd793cff9438e3c250b1456f1666ae
Aug 11 06:49:22 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430962, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:22.631361 19196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:22.613719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:40921 (local address 127.12.145.62:33815)
0811 06:49:22.613927 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:22.613934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:22.615123 (+ 1189us) server_negotiation.cc:407] Connection header received
0811 06:49:22.616903 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:22.616908 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:22.616979 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:22.617072 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:22.618595 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:22.619326 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:22.620896 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:22.621534 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:22.621661 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:22.625405 (+ 3744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:22.625410 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:22.625414 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:22.625448 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:22.627841 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:22.628727 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:22.628732 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:22.628734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:22.628888 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:22.629386 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:22.629391 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:22.629393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:22.629732 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:22.629894 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:22.630744 (+ 850us) server_negotiation.cc:299] Negotiation successful
0811 06:49:22.631032 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 06:49:22.632158 19433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:22.614267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:33815 (local address 127.12.145.2:40921)
0811 06:49:22.614959 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:22.614997 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:22.616636 (+ 1639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:22.617265 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:22.617273 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:22.617872 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:22.618427 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:22.618445 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:22.619459 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:22.619462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:22.620755 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:22.620768 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:22.621774 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:22.621782 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:22.622041 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:22.622648 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:22.622679 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:22.625166 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:22.628000 (+ 2834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:22.628010 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:22.628028 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:22.628581 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:22.628997 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:22.629001 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:22.629005 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:22.629247 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:22.629857 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:22.629864 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:22.630288 (+ 424us) client_negotiation.cc:769] Sending connection context
0811 06:49:22.630599 (+ 311us) client_negotiation.cc:240] Negotiation successful
0811 06:49:22.631025 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":272,"threads_started":1}
I20260811 06:49:22.633615 19431 heartbeater.cc:347] Connected to a master server at 127.12.145.62:33815
I20260811 06:49:22.633909 19431 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:22.634611 19431 heartbeater.cc:511] Master 127.12.145.62:33815 requested a full tablet report, sending...
I20260811 06:49:22.636147 18850 ts_manager.cc:194] Registered new tserver with Master: 0dae1192cb814fc595e7f155c069eacb (127.12.145.2:38931)
I20260811 06:49:22.636960 18850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:40921
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:49:22.670327 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33815
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:35319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:22.999372 19436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:22.999648 19436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:22.999778 19436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:23.007252 19436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:23.007369 19436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:23.007524 19436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:49:23.017750 19436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:35319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33815
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:23.019114 19436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:23.020526 19436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:23.034158 19451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:23.034202 19445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:23.034228 19446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:23.035333 19436 server_base.cc:1034] running on GCE node
I20260811 06:49:23.035936 19436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:23.036837 19436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:23.038051 19436 hybrid_clock.cc:648] HybridClock initialized: now 1786430963038005 us; error 37 us; skew 500 ppm
I20260811 06:49:23.038347 19436 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:23 dist-test-slave-7lbf krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430963, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:23.041473 19436 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:49:23.042930 19436 webserver.cc:460] Webserver started at http://127.12.145.3:35763/ using document root <none> and password file <none>
I20260811 06:49:23.043632 19436 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:23.043754 19436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:23.044126 19436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:23.047226 19436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "6449e9eb3e374a2d84d7a53675784ef2"
format_stamp: "Formatted at 2026-08-11 06:49:23 on dist-test-slave-7lbf"
server_key: "89065c6c956020f75212eac41e4fc367"
server_key_iv: "38b4a9e075ae36c901f09c0982076496"
server_key_version: "encryptionkey@0"
I20260811 06:49:23.048154 19436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "6449e9eb3e374a2d84d7a53675784ef2"
format_stamp: "Formatted at 2026-08-11 06:49:23 on dist-test-slave-7lbf"
server_key: "89065c6c956020f75212eac41e4fc367"
server_key_iv: "38b4a9e075ae36c901f09c0982076496"
server_key_version: "encryptionkey@0"
I20260811 06:49:23.053721 19436 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 06:49:23.057287 19464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:23.058718 19436 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:23.058897 19436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "6449e9eb3e374a2d84d7a53675784ef2"
format_stamp: "Formatted at 2026-08-11 06:49:23 on dist-test-slave-7lbf"
server_key: "89065c6c956020f75212eac41e4fc367"
server_key_iv: "38b4a9e075ae36c901f09c0982076496"
server_key_version: "encryptionkey@0"
I20260811 06:49:23.059093 19436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:23.071379 19436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:23.075543 19436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:23.075815 19436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:23.076731 19436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:23.078136 19436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:23.078214 19436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:23.078336 19436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:23.078389 19436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:23.109542 19436 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:41187
I20260811 06:49:23.109611 19650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:41187 every 8 connection(s)
I20260811 06:49:23.110821 19436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:49:23.112171 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 19436
I20260811 06:49:23.112341 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:49:23.112805 12868 external_mini_cluster.cc:1428] Setting key a32c7646bf4a0add7838c0ee3465e94d
Aug 11 06:49:23 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430963, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:23.131929 19196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:23.113560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:51025 (local address 127.12.145.62:33815)
0811 06:49:23.113753 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:23.113758 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:23.115239 (+ 1481us) server_negotiation.cc:407] Connection header received
0811 06:49:23.117249 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:23.117254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:23.117339 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:23.117422 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:23.118992 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.119758 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.121337 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.121779 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.121902 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:23.125370 (+ 3468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:23.125375 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:23.125379 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:23.125415 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:23.128422 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.129204 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.129210 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.129212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.129366 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.129891 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.129895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.129897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.130198 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:23.130348 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:23.131251 (+ 903us) server_negotiation.cc:299] Negotiation successful
0811 06:49:23.131494 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 06:49:23.132953 19654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:23.114234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:33815 (local address 127.12.145.3:51025)
0811 06:49:23.115072 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:23.115132 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:23.116992 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:23.117710 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:23.117718 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:23.118227 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:23.118828 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:23.118846 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.119926 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.119931 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:23.121192 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:23.121205 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.122010 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.122017 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:23.122250 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:23.122890 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:23.122915 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:23.125164 (+ 2249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:23.128578 (+ 3414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:23.128587 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:23.128602 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:23.129071 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:23.129487 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:23.129491 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:23.129493 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:23.129752 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:23.130347 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:23.130356 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:23.130787 (+ 431us) client_negotiation.cc:769] Sending connection context
0811 06:49:23.131094 (+ 307us) client_negotiation.cc:240] Negotiation successful
0811 06:49:23.131682 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":298,"threads_started":1}
I20260811 06:49:23.134166 19193 heartbeater.cc:503] Master 127.12.145.62:33815 was elected leader, sending a full tablet report...
I20260811 06:49:23.134480 19651 heartbeater.cc:347] Connected to a master server at 127.12.145.62:33815
I20260811 06:49:23.134862 19651 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:23.135763 19651 heartbeater.cc:511] Master 127.12.145.62:33815 requested a full tablet report, sending...
I20260811 06:49:23.137182 18850 ts_manager.cc:194] Registered new tserver with Master: 6449e9eb3e374a2d84d7a53675784ef2 (127.12.145.3:41187)
I20260811 06:49:23.138010 18850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:51025
I20260811 06:49:23.140782 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 06:49:23 dist-test-slave-7lbf krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 06:49:23 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:49:23.194031 19670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:23.178680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37202 (local address 127.12.145.1:39475)
0811 06:49:23.179368 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:23.179378 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:23.179404 (+ 26us) server_negotiation.cc:407] Connection header received
0811 06:49:23.179467 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:23.179475 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:23.179700 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:23.179864 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:23.181413 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.182483 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.183779 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.184378 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.184474 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:23.188383 (+ 3909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:23.188395 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:23.188410 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:23.188444 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:23.191246 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.191942 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.191953 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.191957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.192125 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.192497 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.192501 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.192503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.192906 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:23.193159 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:23.193433 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 06:49:23.193703 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":311,"threads_started":1}
Aug 11 06:49:23 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:23.212143 19196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:23.198721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53714 (local address 127.12.145.62:33815)
0811 06:49:23.198935 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:23.198941 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:23.199163 (+ 222us) server_negotiation.cc:407] Connection header received
0811 06:49:23.199325 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:23.199331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:23.199411 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:23.199504 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:23.200821 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.201652 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.202962 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.203387 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.203483 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:23.207185 (+ 3702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:23.207190 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:23.207194 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:23.207226 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:23.209860 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.210518 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.210522 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.210524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.210664 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.210967 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.210970 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.210972 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.211276 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:23.211462 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:23.211740 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 06:49:23.211901 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 06:49:23.212713 18850 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53714
I20260811 06:49:23.213842 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18959
I20260811 06:49:23.226226 19670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:23.214821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37210 (local address 127.12.145.1:39475)
0811 06:49:23.215033 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:23.215039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:23.215124 (+ 85us) server_negotiation.cc:407] Connection header received
0811 06:49:23.215288 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:23.215292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:23.215368 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:23.215450 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:23.216627 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.217314 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.218563 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.218981 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.219103 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:23.221267 (+ 2164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:23.221272 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:23.221275 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:23.221309 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:23.223796 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.224401 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.224406 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.224408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.224533 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.224881 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.224886 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.224889 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.225141 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:23.225375 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:23.225690 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 06:49:23.225910 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 06:49:23.226950 19185 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:23.312938 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 18959
I20260811 06:49:23.337891 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 19202
Aug 11 06:49:23 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:49:23.353364 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:23.338808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34712 (local address 127.12.145.2:38931)
0811 06:49:23.339337 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:23.339344 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:23.339371 (+ 27us) server_negotiation.cc:407] Connection header received
0811 06:49:23.339438 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:23.339444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:23.339661 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:23.339819 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:23.341091 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.342181 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.343420 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.344007 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.344123 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:23.348183 (+ 4060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:23.348194 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:23.348209 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:23.348243 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:23.350887 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.351525 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.351532 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.351534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.351655 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.351966 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.351969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.351971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.352302 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:23.352531 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:23.352764 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 06:49:23.352979 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":244,"threads_started":1}
I20260811 06:49:23.354679 19424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:23.437726 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 19202
I20260811 06:49:23.462894 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 19436
Aug 11 06:49:23 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:49:23.480647 19684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:23.464109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49112 (local address 127.12.145.3:41187)
0811 06:49:23.464744 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:23.464751 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:23.464782 (+ 31us) server_negotiation.cc:407] Connection header received
0811 06:49:23.464840 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:23.464846 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:23.465080 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:23.465209 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:23.466737 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.467793 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.469246 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:23.470034 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:23.470145 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:23.475221 (+ 5076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:23.475235 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:23.475252 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:23.475293 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:23.478200 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.478874 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.478880 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.478882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.479003 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:23.479304 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:23.479307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:23.479309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:23.479664 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:23.479910 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:23.480128 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 06:49:23.480335 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":328,"threads_started":1}
I20260811 06:49:23.482016 19645 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:23.564193 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 19436
I20260811 06:49:23.587102 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18802
I20260811 06:49:23.588454 18894 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:23.691885 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 18802
2026-08-11T06:49:23Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4138 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:49:23 dist-test-slave-7lbf krb5kdc[19695](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:49:23 dist-test-slave-7lbf krb5kdc[19695](info): set up 2 sockets
Aug 11 06:49:23 dist-test-slave-7lbf krb5kdc[19695](info): commencing operation
krb5kdc: starting...
W20260811 06:49:24.926177 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:49:25 dist-test-slave-7lbf krb5kdc[19695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:49:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:49:25.148612 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:37009
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:37009
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:25.474733 19714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:25.475056 19714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:25.475152 19714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:25.482371 19714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:25.482487 19714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:25.482532 19714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:25.482589 19714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:25.482635 19714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:25.492455 19714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:37009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:37009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:25.493738 19714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:25.495083 19714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:25.506109 19723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:25.506147 19727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:25.506177 19724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:25.507342 19714 server_base.cc:1034] running on GCE node
I20260811 06:49:25.508133 19714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:25.509577 19714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:25.510809 19714 hybrid_clock.cc:648] HybridClock initialized: now 1786430965510740 us; error 53 us; skew 500 ppm
I20260811 06:49:25.511166 19714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:25 dist-test-slave-7lbf krb5kdc[19695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430965, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:25.514237 19714 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:49:25.515363 19714 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:25.515481 19714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:25.515805 19714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:25.518806 19714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "d5e2f9e868fd463ea43565dd4c9885b6"
format_stamp: "Formatted at 2026-08-11 06:49:25 on dist-test-slave-7lbf"
server_key: "84d6e2744a25202fd0fd74facc93bc34"
server_key_iv: "769fe99d7819278da88fd92fa7007a84"
server_key_version: "encryptionkey@0"
I20260811 06:49:25.519609 19714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "d5e2f9e868fd463ea43565dd4c9885b6"
format_stamp: "Formatted at 2026-08-11 06:49:25 on dist-test-slave-7lbf"
server_key: "84d6e2744a25202fd0fd74facc93bc34"
server_key_iv: "769fe99d7819278da88fd92fa7007a84"
server_key_version: "encryptionkey@0"
I20260811 06:49:25.524688 19714 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 06:49:25.528185 19734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:25.529417 19714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:49:25.529613 19714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "d5e2f9e868fd463ea43565dd4c9885b6"
format_stamp: "Formatted at 2026-08-11 06:49:25 on dist-test-slave-7lbf"
server_key: "84d6e2744a25202fd0fd74facc93bc34"
server_key_iv: "769fe99d7819278da88fd92fa7007a84"
server_key_version: "encryptionkey@0"
I20260811 06:49:25.529819 19714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:25.547845 19714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:25.551887 19714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:25.552137 19714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:25.569446 19714 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:37009
I20260811 06:49:25.569470 19820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:37009 every 8 connection(s)
I20260811 06:49:25.570408 19714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:25.574046 19822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:25.580090 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 19714
I20260811 06:49:25.580282 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:25.580892 12868 external_mini_cluster.cc:1428] Setting key aefcc85e600f0a05fad75ed0e6b9961e
I20260811 06:49:25.584478 19822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6: Bootstrap starting.
I20260811 06:49:25.588014 19822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:25.589105 19822 log.cc:824] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:25.592008 19822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6: No bootstrap required, opened a new log
Aug 11 06:49:25 dist-test-slave-7lbf krb5kdc[19695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:25.600247 19822 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e2f9e868fd463ea43565dd4c9885b6" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 37009 } }
I20260811 06:49:25.600629 19822 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:25.600719 19822 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5e2f9e868fd463ea43565dd4c9885b6, State: Initialized, Role: FOLLOWER
I20260811 06:49:25.601382 19822 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e2f9e868fd463ea43565dd4c9885b6" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 37009 } }
I20260811 06:49:25.601703 19822 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:25.601851 19822 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:25.602041 19822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:25.603691 19827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:25.582866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42318 (local address 127.12.145.62:37009)
0811 06:49:25.583653 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:25.583666 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:25.583706 (+ 40us) server_negotiation.cc:407] Connection header received
0811 06:49:25.585430 (+ 1724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:25.585453 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:25.585867 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:25.586187 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:25.588059 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:25.589436 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:25.591105 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:25.591752 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:25.591874 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:25.596430 (+ 4556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:25.596439 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:25.596456 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:25.596498 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:25.599574 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:25.600251 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:25.600258 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:25.600265 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:25.600433 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:25.600819 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:25.600825 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:25.600828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:25.601403 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:25.601718 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:25.602215 (+ 497us) server_negotiation.cc:299] Negotiation successful
0811 06:49:25.602631 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":331,"threads_started":1}
I20260811 06:49:25.604612 19822 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e2f9e868fd463ea43565dd4c9885b6" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 37009 } }
I20260811 06:49:25.605090 19822 leader_election.cc:302] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5e2f9e868fd463ea43565dd4c9885b6; no voters:
I20260811 06:49:25.605820 19822 leader_election.cc:288] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:25.606052 19829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:25.607435 19829 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [term 1 LEADER]: Becoming Leader. State: Replica: d5e2f9e868fd463ea43565dd4c9885b6, State: Running, Role: LEADER
I20260811 06:49:25.607901 19829 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e2f9e868fd463ea43565dd4c9885b6" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 37009 } }
I20260811 06:49:25.608147 19822 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:25.610610 19833 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5e2f9e868fd463ea43565dd4c9885b6. Latest consensus state: current_term: 1 leader_uuid: "d5e2f9e868fd463ea43565dd4c9885b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e2f9e868fd463ea43565dd4c9885b6" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 37009 } } }
I20260811 06:49:25.611020 19833 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:25.611495 19832 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5e2f9e868fd463ea43565dd4c9885b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5e2f9e868fd463ea43565dd4c9885b6" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 37009 } } }
I20260811 06:49:25.611788 19832 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:25.618655 19842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:25.624362 19842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:25.634258 19842 catalog_manager.cc:1347] Generated new cluster ID: b681181fcb114b35a40e7afd097fcad8
I20260811 06:49:25.634431 19842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:25.656710 19842 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:25.658412 19842 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:25.665944 19842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6: Generated new TSK 0
I20260811 06:49:25.666759 19842 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:49:25.734118 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:37009
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:26.070986 19872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:26.071286 19872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:26.071391 19872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:26.078660 19872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:26.078778 19872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:26.078917 19872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:49:26.088848 19872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:37009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:26.090193 19872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:26.091590 19872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:26.104619 19881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:26.104596 19884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:26.104650 19880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:26.105482 19872 server_base.cc:1034] running on GCE node
I20260811 06:49:26.106128 19872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:26.107097 19872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:26.108299 19872 hybrid_clock.cc:648] HybridClock initialized: now 1786430966108251 us; error 36 us; skew 500 ppm
I20260811 06:49:26.108670 19872 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:26 dist-test-slave-7lbf krb5kdc[19695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430966, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:26.111807 19872 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:49:26.112944 19872 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:26.113054 19872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:26.113380 19872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:26.116391 19872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "669082a5182e45cd91c46869fea35839"
format_stamp: "Formatted at 2026-08-11 06:49:26 on dist-test-slave-7lbf"
server_key: "9fab343df555d755269e11da1e4d0f13"
server_key_iv: "00cea1d070c685675d65d29390ba4bd6"
server_key_version: "encryptionkey@0"
I20260811 06:49:26.117210 19872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "669082a5182e45cd91c46869fea35839"
format_stamp: "Formatted at 2026-08-11 06:49:26 on dist-test-slave-7lbf"
server_key: "9fab343df555d755269e11da1e4d0f13"
server_key_iv: "00cea1d070c685675d65d29390ba4bd6"
server_key_version: "encryptionkey@0"
I20260811 06:49:26.122669 19872 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 06:49:26.126175 19894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:26.127583 19872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:26.127741 19872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "669082a5182e45cd91c46869fea35839"
format_stamp: "Formatted at 2026-08-11 06:49:26 on dist-test-slave-7lbf"
server_key: "9fab343df555d755269e11da1e4d0f13"
server_key_iv: "00cea1d070c685675d65d29390ba4bd6"
server_key_version: "encryptionkey@0"
I20260811 06:49:26.127964 19872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:26.161329 19872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:26.165669 19872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:26.166016 19872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:26.167045 19872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:26.168488 19872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:26.168591 19872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:26.168701 19872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:26.168771 19872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:26.198725 19872 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:35797
I20260811 06:49:26.198770 20100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:35797 every 8 connection(s)
I20260811 06:49:26.199661 19872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:49:26.200397 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 19872
I20260811 06:49:26.200595 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:49:26.201297 12868 external_mini_cluster.cc:1428] Setting key b5811e17df7ffd7f0cb43bf034672539
Aug 11 06:49:26 dist-test-slave-7lbf krb5kdc[19695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430966, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:26.220664 20105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:26.202279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:40973 (local address 127.12.145.62:37009)
0811 06:49:26.202761 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:26.202767 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:26.203859 (+ 1092us) server_negotiation.cc:407] Connection header received
0811 06:49:26.205811 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:26.205816 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:26.205904 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:26.206026 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:26.207528 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:26.208496 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:26.210560 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:26.211101 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:26.211229 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:26.214896 (+ 3667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:26.214901 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:26.214904 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:26.214940 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:26.217464 (+ 2524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:26.218216 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:26.218221 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:26.218223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:26.218348 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:26.218763 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:26.218767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:26.218769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:26.219062 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:26.219200 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:26.220008 (+ 808us) server_negotiation.cc:299] Negotiation successful
0811 06:49:26.220256 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":244,"threads_started":1}
I20260811 06:49:26.221709 20106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:26.202892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:37009 (local address 127.12.145.1:40973)
0811 06:49:26.203678 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:26.203725 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:26.205510 (+ 1785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:26.206203 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:26.206211 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:26.206731 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:26.207346 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:26.207367 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:26.208663 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:26.208668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:26.210386 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:26.210400 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:26.211318 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:26.211325 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:26.211599 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:26.212306 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:26.212329 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:26.214683 (+ 2354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:26.217620 (+ 2937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:26.217629 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:26.217646 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:26.218090 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:26.218460 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:26.218465 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:26.218469 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:26.218651 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:26.219202 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:26.219211 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:26.219580 (+ 369us) client_negotiation.cc:769] Sending connection context
0811 06:49:26.219834 (+ 254us) client_negotiation.cc:240] Negotiation successful
0811 06:49:26.220422 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":319,"threads_started":1}
I20260811 06:49:26.223316 20102 heartbeater.cc:347] Connected to a master server at 127.12.145.62:37009
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
I20260811 06:49:26.223699 20102 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:26.224395 20102 heartbeater.cc:511] Master 127.12.145.62:37009 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
I20260811 06:49:26.226579 19770 ts_manager.cc:194] Registered new tserver with Master: 669082a5182e45cd91c46869fea35839 (127.12.145.1:35797)
I20260811 06:49:26.228046 19770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:40973
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:49:26.250841 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:37009
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:26.602571 20110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:26.602872 20110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:26.602990 20110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:26.610399 20110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:26.610515 20110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:26.610666 20110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:49:26.620726 20110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:37009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:26.622143 20110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:26.623474 20110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:26.636922 20117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:26.637027 20115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:26.637008 20120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:26.638057 20110 server_base.cc:1034] running on GCE node
I20260811 06:49:26.638659 20110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:26.639556 20110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:26.640750 20110 hybrid_clock.cc:648] HybridClock initialized: now 1786430966640699 us; error 50 us; skew 500 ppm
I20260811 06:49:26.641047 20110 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:26 dist-test-slave-7lbf krb5kdc[19695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430966, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:26.647035 20110 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:49:26.648238 20110 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:26.648360 20110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:26.648690 20110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:26.651763 20110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "868e263951794f0591b6f138ce58e585"
format_stamp: "Formatted at 2026-08-11 06:49:26 on dist-test-slave-7lbf"
server_key: "b184e1fc4e07795cd2ce08d8c3940909"
server_key_iv: "fe43e9be87b6ecdee5a654672e5fb69b"
server_key_version: "encryptionkey@0"
I20260811 06:49:26.652588 20110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "868e263951794f0591b6f138ce58e585"
format_stamp: "Formatted at 2026-08-11 06:49:26 on dist-test-slave-7lbf"
server_key: "b184e1fc4e07795cd2ce08d8c3940909"
server_key_iv: "fe43e9be87b6ecdee5a654672e5fb69b"
server_key_version: "encryptionkey@0"
I20260811 06:49:26.657931 20110 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:49:26.661401 20128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:26.662798 20110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:26.662961 20110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "868e263951794f0591b6f138ce58e585"
format_stamp: "Formatted at 2026-08-11 06:49:26 on dist-test-slave-7lbf"
server_key: "b184e1fc4e07795cd2ce08d8c3940909"
server_key_iv: "fe43e9be87b6ecdee5a654672e5fb69b"
server_key_version: "encryptionkey@0"
I20260811 06:49:26.663175 20110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:26.682132 20110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:26.686254 20110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:26.686508 20110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:26.687458 20110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:26.688792 20110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:26.688887 20110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:26.689002 20110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:26.689072 20110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:26.719859 20110 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:41615
I20260811 06:49:26.719914 20312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:41615 every 8 connection(s)
I20260811 06:49:26.720816 20110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:49:26.723744 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 20110
I20260811 06:49:26.723920 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:49:26.724409 12868 external_mini_cluster.cc:1428] Setting key 9baecbd6642d5376f8e422f2e9be2323
Aug 11 06:49:26 dist-test-slave-7lbf krb5kdc[19695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430966, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:26.740924 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:26.723373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:49463 (local address 127.12.145.62:37009)
0811 06:49:26.723912 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:26.723918 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:26.724951 (+ 1033us) server_negotiation.cc:407] Connection header received
0811 06:49:26.727049 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:26.727054 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:26.727146 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:26.727251 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:26.728674 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:26.729647 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:26.731145 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:26.731769 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:26.731892 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:26.735310 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:26.735315 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:26.735319 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:26.735353 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:26.737947 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:26.738682 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:26.738686 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:26.738688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:26.738812 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:26.739221 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:26.739225 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:26.739227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:26.739487 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:26.739619 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:26.740297 (+ 678us) server_negotiation.cc:299] Negotiation successful
0811 06:49:26.740531 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":233,"threads_started":1}
I20260811 06:49:26.742000 20321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:26.723912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:37009 (local address 127.12.145.2:49463)
0811 06:49:26.724773 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:26.724828 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:26.726776 (+ 1948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:26.727430 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:26.727438 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:26.727956 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:26.728504 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:26.728522 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:26.729768 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:26.729772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:26.731001 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:26.731013 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:26.731966 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:26.731971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:26.732159 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:26.732882 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:26.732905 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:26.735097 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:26.738082 (+ 2985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:26.738092 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:26.738118 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:26.738562 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:26.738925 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:26.738930 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:26.738934 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:26.739112 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:26.739620 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:26.739628 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:26.739949 (+ 321us) client_negotiation.cc:769] Sending connection context
0811 06:49:26.740193 (+ 244us) client_negotiation.cc:240] Negotiation successful
0811 06:49:26.740731 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":334,"threads_started":1}
I20260811 06:49:26.743583 20314 heartbeater.cc:347] Connected to a master server at 127.12.145.62:37009
I20260811 06:49:26.743870 20314 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:26.744516 20314 heartbeater.cc:511] Master 127.12.145.62:37009 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
I20260811 06:49:26.746011 19770 ts_manager.cc:194] Registered new tserver with Master: 868e263951794f0591b6f138ce58e585 (127.12.145.2:41615)
I20260811 06:49:26.746798 19770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:49463
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:49:26.774706 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:37009
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:27.097194 20324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:27.097473 20324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:27.097618 20324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:27.104727 20324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:27.104837 20324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:27.104950 20324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:49:27.114907 20324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:37009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:27.116173 20324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:27.117436 20324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:27.129912 20333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:27.129871 20336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:27.129864 20338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:27.130774 20324 server_base.cc:1034] running on GCE node
I20260811 06:49:27.131417 20324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:27.132364 20324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:27.133586 20324 hybrid_clock.cc:648] HybridClock initialized: now 1786430967133527 us; error 48 us; skew 500 ppm
I20260811 06:49:27.133904 20324 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:27 dist-test-slave-7lbf krb5kdc[19695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430967, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:27.136945 20324 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:49:27.138052 20324 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:27.138149 20324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:27.138494 20324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:27.141372 20324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "f739360a0eb141ccb169fafb3268ef5a"
format_stamp: "Formatted at 2026-08-11 06:49:27 on dist-test-slave-7lbf"
server_key: "384a65392866e82846ff6067f4509ddc"
server_key_iv: "036a00cf2e41047fd9d3d2ec3354214a"
server_key_version: "encryptionkey@0"
I20260811 06:49:27.142199 20324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "f739360a0eb141ccb169fafb3268ef5a"
format_stamp: "Formatted at 2026-08-11 06:49:27 on dist-test-slave-7lbf"
server_key: "384a65392866e82846ff6067f4509ddc"
server_key_iv: "036a00cf2e41047fd9d3d2ec3354214a"
server_key_version: "encryptionkey@0"
I20260811 06:49:27.147074 20324 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 06:49:27.150625 20349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:27.151984 20324 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:49:27.152149 20324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "f739360a0eb141ccb169fafb3268ef5a"
format_stamp: "Formatted at 2026-08-11 06:49:27 on dist-test-slave-7lbf"
server_key: "384a65392866e82846ff6067f4509ddc"
server_key_iv: "036a00cf2e41047fd9d3d2ec3354214a"
server_key_version: "encryptionkey@0"
I20260811 06:49:27.152382 20324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:27.176805 20324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:27.180611 20324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:27.180862 20324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:27.181916 20324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:27.183234 20324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:27.183326 20324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:27.183439 20324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:27.183506 20324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:27.214210 20324 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:33127
I20260811 06:49:27.214264 20557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:33127 every 8 connection(s)
I20260811 06:49:27.215086 20324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:49:27.216163 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 20324
I20260811 06:49:27.216354 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:49:27.216888 12868 external_mini_cluster.cc:1428] Setting key 12604f13024cc2026cd54a4dde7ab7f6
Aug 11 06:49:27 dist-test-slave-7lbf krb5kdc[19695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430967, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:27.231041 20102 heartbeater.cc:503] Master 127.12.145.62:37009 was elected leader, sending a full tablet report...
I20260811 06:49:27.235580 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.217801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:37837 (local address 127.12.145.62:37009)
0811 06:49:27.218096 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.218103 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.219402 (+ 1299us) server_negotiation.cc:407] Connection header received
0811 06:49:27.221412 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.221417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.221552 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.221648 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:27.223226 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.223990 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.225581 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.225963 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.226076 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.229404 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:27.229409 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:27.229413 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:27.229446 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:27.232808 (+ 3362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:27.233594 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:27.233600 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:27.233603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:27.233746 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:27.234151 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:27.234154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:27.234156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:27.234429 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:27.234548 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.235166 (+ 618us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.235327 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260811 06:49:27.236547 20565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.218443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:37009 (local address 127.12.145.3:37837)
0811 06:49:27.219251 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:27.219295 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:27.221140 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:27.221901 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:27.221910 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:27.222462 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:27.223044 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.223064 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.224140 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.224144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.225382 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.225396 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.226187 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.226195 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.226399 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.227037 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:27.227061 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:27.229200 (+ 2139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:27.232974 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:27.232984 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:27.233001 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:27.233444 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:27.233847 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:27.233851 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:27.233854 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:27.234047 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:27.234540 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:27.234545 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:27.234863 (+ 318us) client_negotiation.cc:769] Sending connection context
0811 06:49:27.235095 (+ 232us) client_negotiation.cc:240] Negotiation successful
0811 06:49:27.235494 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":319,"threads_started":1}
I20260811 06:49:27.237735 20558 heartbeater.cc:347] Connected to a master server at 127.12.145.62:37009
I20260811 06:49:27.238030 20558 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:27.238658 20558 heartbeater.cc:511] Master 127.12.145.62:37009 requested a full tablet report, sending...
I20260811 06:49:27.240111 19766 ts_manager.cc:194] Registered new tserver with Master: f739360a0eb141ccb169fafb3268ef5a (127.12.145.3:33127)
I20260811 06:49:27.241060 19766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:37837
I20260811 06:49:27.244988 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:49:27.261236 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.249223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42326 (local address 127.12.145.62:37009)
0811 06:49:27.249379 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.249385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.249866 (+ 481us) server_negotiation.cc:407] Connection header received
0811 06:49:27.250037 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.250043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.250122 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.250209 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:27.251618 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.252311 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.253581 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.254008 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.254118 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.256269 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:27.256274 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:27.256277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:27.256308 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:27.258744 (+ 2436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:27.259359 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:27.259364 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:27.259367 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:27.259493 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:27.259843 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:27.259847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:27.259849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:27.260165 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:27.260398 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.260708 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.260918 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 06:49:27.265013 19766 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42326:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:49:27.271862 19766 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:49:27.294374 20582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.283515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37016 (local address 127.12.145.2:41615)
0811 06:49:27.285813 (+ 2298us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.285821 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.285849 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:49:27.285947 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.285954 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.286199 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.287153 (+ 954us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:27.287389 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.288853 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.291689 (+ 2836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.293079 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.293220 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.293430 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.293859 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.294027 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2143,"thread_start_us":4362,"threads_started":1}
I20260811 06:49:27.294436 20579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.283239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:41615 (local address 127.0.0.1:37016)
0811 06:49:27.284076 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:27.284116 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:27.284287 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:27.286457 (+ 2170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:27.286464 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:27.286497 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:27.286933 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.286948 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.289004 (+ 2056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.289009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.291483 (+ 2474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.291499 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.293295 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.293302 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.293590 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.293651 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 06:49:27.293803 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 06:49:27.293994 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"mutex_wait_us":28,"thread_start_us":6221,"threads_started":1}
I20260811 06:49:27.296695 20588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.283423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:33127 (local address 127.0.0.1:39384)
0811 06:49:27.289065 (+ 5642us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:27.289088 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:27.289315 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:27.290058 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:27.290066 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:27.290092 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:27.290477 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.290489 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.292322 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.292327 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.294021 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.294039 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.295982 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.295986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.296104 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.296125 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 06:49:27.296201 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 06:49:27.296322 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5509,"mutex_wait_us":21,"thread_start_us":669,"threads_started":1}
I20260811 06:49:27.296738 20583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.283833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39384 (local address 127.12.145.3:33127)
0811 06:49:27.285400 (+ 1567us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.285409 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.289198 (+ 3789us) server_negotiation.cc:407] Connection header received
0811 06:49:27.289540 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.289549 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.289776 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.289926 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:27.290736 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.292167 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.294206 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.295500 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.295594 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.295818 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.296269 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.296423 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1389,"thread_start_us":2570,"threads_started":1}
I20260811 06:49:27.298202 20576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.286077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35797 (local address 127.0.0.1:38456)
0811 06:49:27.289778 (+ 3701us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:27.289795 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:27.289933 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:27.290562 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:27.290566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:27.290590 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:27.291009 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.291022 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.293409 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.293414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.295741 (+ 2327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.295754 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.297652 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.297659 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.297807 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.297831 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 06:49:27.297893 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 06:49:27.297988 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3558,"thread_start_us":3067,"threads_started":1}
I20260811 06:49:27.298689 20206 tablet_service.cc:1467] Processing CreateTablet for tablet 0549456070364344a80ccb5ee247691f (DEFAULT_TABLE table=test-table [id=eb603576d4a64deba20d7bc016c04e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:27.299893 20585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.285716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38456 (local address 127.12.145.1:35797)
0811 06:49:27.288602 (+ 2886us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.288611 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.289914 (+ 1303us) server_negotiation.cc:407] Connection header received
0811 06:49:27.290121 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.290129 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.290357 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.290563 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:27.291200 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.293206 (+ 2006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.295941 (+ 2735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.297422 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.297587 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.299481 (+ 1894us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.299536 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.299654 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2698,"thread_start_us":2511,"threads_started":1}
I20260811 06:49:27.300282 20206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0549456070364344a80ccb5ee247691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:27.300343 20445 tablet_service.cc:1467] Processing CreateTablet for tablet 0549456070364344a80ccb5ee247691f (DEFAULT_TABLE table=test-table [id=eb603576d4a64deba20d7bc016c04e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:27.302382 20445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0549456070364344a80ccb5ee247691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:27.303354 19973 tablet_service.cc:1467] Processing CreateTablet for tablet 0549456070364344a80ccb5ee247691f (DEFAULT_TABLE table=test-table [id=eb603576d4a64deba20d7bc016c04e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:27.305040 19973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0549456070364344a80ccb5ee247691f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:27.313872 20589 tablet_bootstrap.cc:492] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: Bootstrap starting.
I20260811 06:49:27.314880 20590 tablet_bootstrap.cc:492] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: Bootstrap starting.
I20260811 06:49:27.318233 20592 tablet_bootstrap.cc:492] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: Bootstrap starting.
I20260811 06:49:27.318528 20590 tablet_bootstrap.cc:654] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:27.319276 20589 tablet_bootstrap.cc:654] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:27.319788 20590 log.cc:824] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:27.320557 20589 log.cc:824] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:27.321761 20592 tablet_bootstrap.cc:654] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:27.322757 20590 tablet_bootstrap.cc:492] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: No bootstrap required, opened a new log
I20260811 06:49:27.322960 20592 log.cc:824] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:27.323017 20590 ts_tablet_manager.cc:1397] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.001s
I20260811 06:49:27.323693 20589 tablet_bootstrap.cc:492] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: No bootstrap required, opened a new log
I20260811 06:49:27.323983 20589 ts_tablet_manager.cc:1397] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260811 06:49:27.326036 20592 tablet_bootstrap.cc:492] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: No bootstrap required, opened a new log
I20260811 06:49:27.326326 20592 ts_tablet_manager.cc:1397] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.005s
I20260811 06:49:27.331723 20589 raft_consensus.cc:348] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 } } peers { permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 } } peers { permanent_uuid: "669082a5182e45cd91c46869fea35839" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35797 } }
I20260811 06:49:27.332196 20589 raft_consensus.cc:374] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:27.332295 20589 raft_consensus.cc:729] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f739360a0eb141ccb169fafb3268ef5a, State: Initialized, Role: FOLLOWER
I20260811 06:49:27.332965 20589 consensus_queue.cc:260] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 } } peers { permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 } } peers { permanent_uuid: "669082a5182e45cd91c46869fea35839" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35797 } }
I20260811 06:49:27.333165 20590 raft_consensus.cc:348] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 } } peers { permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 } } peers { permanent_uuid: "669082a5182e45cd91c46869fea35839" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35797 } }
I20260811 06:49:27.333648 20590 raft_consensus.cc:374] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:27.333777 20590 raft_consensus.cc:729] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 868e263951794f0591b6f138ce58e585, State: Initialized, Role: FOLLOWER
I20260811 06:49:27.334429 20558 heartbeater.cc:503] Master 127.12.145.62:37009 was elected leader, sending a full tablet report...
I20260811 06:49:27.334380 20590 consensus_queue.cc:260] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 } } peers { permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 } } peers { permanent_uuid: "669082a5182e45cd91c46869fea35839" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35797 } }
I20260811 06:49:27.334987 20589 ts_tablet_manager.cc:1428] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260811 06:49:27.335901 20314 heartbeater.cc:503] Master 127.12.145.62:37009 was elected leader, sending a full tablet report...
I20260811 06:49:27.336495 20590 ts_tablet_manager.cc:1428] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: Time spent starting tablet: real 0.013s user 0.006s sys 0.007s
I20260811 06:49:27.336481 20592 raft_consensus.cc:348] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 } } peers { permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 } } peers { permanent_uuid: "669082a5182e45cd91c46869fea35839" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35797 } }
I20260811 06:49:27.336894 20592 raft_consensus.cc:374] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:27.337033 20592 raft_consensus.cc:729] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669082a5182e45cd91c46869fea35839, State: Initialized, Role: FOLLOWER
I20260811 06:49:27.337678 20592 consensus_queue.cc:260] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 } } peers { permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 } } peers { permanent_uuid: "669082a5182e45cd91c46869fea35839" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35797 } }
I20260811 06:49:27.339332 20592 ts_tablet_manager.cc:1428] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260811 06:49:27.434291 20602 raft_consensus.cc:482] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:27.434634 20602 raft_consensus.cc:504] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 } } peers { permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 } } peers { permanent_uuid: "669082a5182e45cd91c46869fea35839" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35797 } }
I20260811 06:49:27.436394 20602 leader_election.cc:288] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 868e263951794f0591b6f138ce58e585 (127.12.145.2:41615), f739360a0eb141ccb169fafb3268ef5a (127.12.145.3:33127)
I20260811 06:49:27.443540 20583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.436910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:39779 (local address 127.12.145.3:33127)
0811 06:49:27.437113 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.437120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.437920 (+ 800us) server_negotiation.cc:407] Connection header received
0811 06:49:27.438091 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.438095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.438155 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.438227 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:27.438824 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.439521 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.441841 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.442630 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.442776 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.442851 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.443178 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.443302 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:49:27.443645 20582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.436845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:55215 (local address 127.12.145.2:41615)
0811 06:49:27.437091 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.437099 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.437866 (+ 767us) server_negotiation.cc:407] Connection header received
0811 06:49:27.438045 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.438049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.438110 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.438185 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:27.438774 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.439483 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.441912 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.442737 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.442877 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.442947 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.443253 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.443399 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 06:49:27.443708 20609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.436832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:33127 (local address 127.12.145.1:39779)
0811 06:49:27.437811 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:27.437826 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:27.437958 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:27.438254 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:27.438258 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:27.438280 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:27.438670 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.438679 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.439655 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.439660 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.441698 (+ 2038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.441712 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.442826 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.442832 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.443025 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.443050 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 06:49:27.443130 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 06:49:27.443253 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"mutex_wait_us":147,"thread_start_us":546,"threads_started":1}
I20260811 06:49:27.443732 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.436694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:41615 (local address 127.12.145.1:55215)
0811 06:49:27.437746 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:27.437762 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:27.437914 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:27.438213 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:27.438217 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:27.438242 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:27.438625 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.438637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.439604 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.439609 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.441691 (+ 2082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:27.441708 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.442964 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.442971 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:27.443111 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.443134 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 06:49:27.443210 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 06:49:27.443327 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":914,"mutex_wait_us":141,"thread_start_us":646,"threads_started":1}
I20260811 06:49:27.444705 20242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0549456070364344a80ccb5ee247691f" candidate_uuid: "669082a5182e45cd91c46869fea35839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868e263951794f0591b6f138ce58e585" is_pre_election: true
I20260811 06:49:27.444934 20483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0549456070364344a80ccb5ee247691f" candidate_uuid: "669082a5182e45cd91c46869fea35839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f739360a0eb141ccb169fafb3268ef5a" is_pre_election: true
I20260811 06:49:27.445200 20242 raft_consensus.cc:2454] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669082a5182e45cd91c46869fea35839 in term 0.
I20260811 06:49:27.445430 20483 raft_consensus.cc:2454] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669082a5182e45cd91c46869fea35839 in term 0.
I20260811 06:49:27.445942 19897 leader_election.cc:302] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669082a5182e45cd91c46869fea35839, 868e263951794f0591b6f138ce58e585; no voters:
I20260811 06:49:27.446368 20602 raft_consensus.cc:2781] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:49:27.446504 20602 raft_consensus.cc:482] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:49:27.446604 20602 raft_consensus.cc:3037] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:27.448877 20602 raft_consensus.cc:504] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 } } peers { permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 } } peers { permanent_uuid: "669082a5182e45cd91c46869fea35839" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35797 } }
I20260811 06:49:27.449457 20602 leader_election.cc:288] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [CANDIDATE]: Term 1 election: Requested vote from peers 868e263951794f0591b6f138ce58e585 (127.12.145.2:41615), f739360a0eb141ccb169fafb3268ef5a (127.12.145.3:33127)
I20260811 06:49:27.449908 20242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0549456070364344a80ccb5ee247691f" candidate_uuid: "669082a5182e45cd91c46869fea35839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "868e263951794f0591b6f138ce58e585"
I20260811 06:49:27.449977 20483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0549456070364344a80ccb5ee247691f" candidate_uuid: "669082a5182e45cd91c46869fea35839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f739360a0eb141ccb169fafb3268ef5a"
I20260811 06:49:27.450088 20242 raft_consensus.cc:3037] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:27.450169 20483 raft_consensus.cc:3037] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:49:27.451922 20103 tablet.cc:2369] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:49:27.452445 20483 raft_consensus.cc:2454] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669082a5182e45cd91c46869fea35839 in term 1.
I20260811 06:49:27.452615 20242 raft_consensus.cc:2454] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669082a5182e45cd91c46869fea35839 in term 1.
I20260811 06:49:27.452886 19896 leader_election.cc:302] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669082a5182e45cd91c46869fea35839, f739360a0eb141ccb169fafb3268ef5a; no voters:
I20260811 06:49:27.453161 20602 raft_consensus.cc:2781] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:27.453619 20602 raft_consensus.cc:686] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 1 LEADER]: Becoming Leader. State: Replica: 669082a5182e45cd91c46869fea35839, State: Running, Role: LEADER
I20260811 06:49:27.454144 20602 consensus_queue.cc:237] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 } } peers { permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 } } peers { permanent_uuid: "669082a5182e45cd91c46869fea35839" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35797 } }
I20260811 06:49:27.458485 19764 catalog_manager.cc:5495] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 reported cstate change: term changed from 0 to 1, leader changed from <none> to 669082a5182e45cd91c46869fea35839 (127.12.145.1). New cstate: current_term: 1 leader_uuid: "669082a5182e45cd91c46869fea35839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "669082a5182e45cd91c46869fea35839" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35797 } health_report { overall_health: HEALTHY } } }
W20260811 06:49:27.466523 20563 tablet.cc:2369] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:49:27.472674 20315 tablet.cc:2369] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:49:27.490105 20585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.485178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38466 (local address 127.12.145.1:35797)
0811 06:49:27.485365 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.485370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.485388 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:49:27.485559 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.485563 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.485642 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.485769 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:27.486200 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.486945 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.488176 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.488563 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.488650 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.489056 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:27.489617 (+ 561us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:27.489721 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.489803 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.489875 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 06:49:27.498347 20242 raft_consensus.cc:1261] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585 [term 1 FOLLOWER]: Refusing update from remote peer 669082a5182e45cd91c46869fea35839: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:27.498347 20483 raft_consensus.cc:1261] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a [term 1 FOLLOWER]: Refusing update from remote peer 669082a5182e45cd91c46869fea35839: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:27.499433 20612 consensus_queue.cc:1035] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f739360a0eb141ccb169fafb3268ef5a" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:27.499814 20602 consensus_queue.cc:1035] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "868e263951794f0591b6f138ce58e585" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 41615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:27.512275 20616 mvcc.cc:205] Tried to move back new op lower bound from 7317221242862133248 to 7317221242695458816. Current Snapshot: MvccSnapshot[applied={T|T < 7317221242862133248}]
I20260811 06:49:27.526367 19770 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42326:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:27.526612 19770 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42326:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:27.530084 19770 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5e2f9e868fd463ea43565dd4c9885b6: Sending DeleteTablet for 3 replicas of tablet 0549456070364344a80ccb5ee247691f
I20260811 06:49:27.531188 19973 tablet_service.cc:1514] Processing DeleteTablet for tablet 0549456070364344a80ccb5ee247691f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:27 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:38456
I20260811 06:49:27.531212 20445 tablet_service.cc:1514] Processing DeleteTablet for tablet 0549456070364344a80ccb5ee247691f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:27 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:39384
I20260811 06:49:27.531347 20206 tablet_service.cc:1514] Processing DeleteTablet for tablet 0549456070364344a80ccb5ee247691f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:27 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:37016
I20260811 06:49:27.532191 20637 tablet_replica.cc:330] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: stopping tablet replica
I20260811 06:49:27.532668 20637 raft_consensus.cc:2229] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:49:27.533469 20637 raft_consensus.cc:2258] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:27.534117 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 19872
I20260811 06:49:27.535774 20637 ts_tablet_manager.cc:1905] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:27.543319 20637 ts_tablet_manager.cc:1918] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:49:27.543533 20637 log.cc:1196] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/0549456070364344a80ccb5ee247691f
I20260811 06:49:27.544147 20637 ts_tablet_manager.cc:1939] T 0549456070364344a80ccb5ee247691f P 669082a5182e45cd91c46869fea35839: Deleting consensus metadata
I20260811 06:49:27.546053 19740 catalog_manager.cc:4841] TS 669082a5182e45cd91c46869fea35839 (127.12.145.1:35797): tablet 0549456070364344a80ccb5ee247691f (table test-table [id=eb603576d4a64deba20d7bc016c04e15]) successfully deleted
I20260811 06:49:27.550789 20641 tablet_replica.cc:330] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: stopping tablet replica
I20260811 06:49:27.551353 20641 raft_consensus.cc:2229] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:27.551934 20641 raft_consensus.cc:2258] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:27.552807 20638 tablet_replica.cc:330] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: stopping tablet replica
I20260811 06:49:27.553256 20638 raft_consensus.cc:2229] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:27.553840 20638 raft_consensus.cc:2258] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:27.554667 20641 ts_tablet_manager.cc:1905] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:27.555953 20638 ts_tablet_manager.cc:1905] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 06:49:27 dist-test-slave-7lbf krb5kdc[19695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:49:27.562356 20641 ts_tablet_manager.cc:1918] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:49:27.562572 20641 log.cc:1196] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/0549456070364344a80ccb5ee247691f
I20260811 06:49:27.563130 20641 ts_tablet_manager.cc:1939] T 0549456070364344a80ccb5ee247691f P 868e263951794f0591b6f138ce58e585: Deleting consensus metadata
I20260811 06:49:27.563364 20638 ts_tablet_manager.cc:1918] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:49:27.563558 20638 log.cc:1196] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/0549456070364344a80ccb5ee247691f
I20260811 06:49:27.564117 20638 ts_tablet_manager.cc:1939] T 0549456070364344a80ccb5ee247691f P f739360a0eb141ccb169fafb3268ef5a: Deleting consensus metadata
I20260811 06:49:27.565038 19738 catalog_manager.cc:4841] TS 868e263951794f0591b6f138ce58e585 (127.12.145.2:41615): tablet 0549456070364344a80ccb5ee247691f (table test-table [id=eb603576d4a64deba20d7bc016c04e15]) successfully deleted
I20260811 06:49:27.565812 19737 catalog_manager.cc:4841] TS f739360a0eb141ccb169fafb3268ef5a (127.12.145.3:33127): tablet 0549456070364344a80ccb5ee247691f (table test-table [id=eb603576d4a64deba20d7bc016c04e15]) successfully deleted
I20260811 06:49:27.568665 20585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.537246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38474 (local address 127.12.145.1:35797)
0811 06:49:27.537453 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.537459 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.550082 (+ 12623us) server_negotiation.cc:407] Connection header received
0811 06:49:27.550311 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.550317 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.550425 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.550520 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:27.552659 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.553449 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.555015 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.555734 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.555829 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.561158 (+ 5329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:27.561179 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:27.561199 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:27.561246 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:27.565197 (+ 3951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:27.566504 (+ 1307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:27.566512 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:27.566516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:27.566678 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:27.567051 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:27.567055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:27.567059 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:27.567454 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:27.567745 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.568045 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.568289 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:49:27.569334 20089 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:27.667066 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 19872
I20260811 06:49:27.692701 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 20110
Aug 11 06:49:27 dist-test-slave-7lbf krb5kdc[19695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:49:27.706527 20582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.693403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56308 (local address 127.12.145.2:41615)
0811 06:49:27.693642 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.693647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.693667 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:49:27.693789 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.693793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.693856 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.693936 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:27.695050 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.695818 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.697001 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.697360 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.697447 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.701404 (+ 3957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:27.701418 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:27.701434 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:27.701466 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:27.704023 (+ 2557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:27.704592 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:27.704599 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:27.704601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:27.704720 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:27.705095 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:27.705097 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:27.705099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:27.705460 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:27.705828 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.706035 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.706202 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 06:49:27.707154 20303 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:27.795020 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 20110
I20260811 06:49:27.821553 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 20324
Aug 11 06:49:27 dist-test-slave-7lbf krb5kdc[19695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:49:27.835635 20583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:27.822365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59288 (local address 127.12.145.3:33127)
0811 06:49:27.822527 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:27.822531 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:27.822550 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:49:27.822680 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:27.822684 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:27.822759 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:27.822840 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:27.824044 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.824754 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.826052 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:27.826432 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:27.826523 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:27.830549 (+ 4026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:27.830565 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:27.830583 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:27.830618 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:27.833181 (+ 2563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:27.833828 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:27.833835 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:27.833837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:27.833961 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:27.834282 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:27.834285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:27.834286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:27.834649 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:27.834856 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:27.835128 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 06:49:27.835289 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 06:49:27.836246 20546 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:27.922508 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 20324
I20260811 06:49:27.945324 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 19714
I20260811 06:49:27.946486 19815 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:28.053993 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 19714
2026-08-11T06:49:28Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4360 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T06:49:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:28Z Disabled control of system clock
I20260811 06:49:28.133563 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:39491
--webserver_interface=127.12.145.62
--webserver_port=0
--builtin_ntp_servers=127.12.145.20:40263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:39491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 06:49:28.460021 20655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:28.460328 20655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:28.460421 20655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:28.467752 20655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:28.467878 20655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:28.467918 20655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:28.467975 20655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:28.468019 20655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:28.477268 20655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:40263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:39491
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:39491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:28.478667 20655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:28.480417 20655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:28.491997 20663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:28.491951 20665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:28.491918 20667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:28.492750 20655 server_base.cc:1034] running on GCE node
I20260811 06:49:28.493558 20655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:28.495014 20655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:28.496234 20655 hybrid_clock.cc:648] HybridClock initialized: now 1786430968496191 us; error 39 us; skew 500 ppm
I20260811 06:49:28.496588 20655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:49:28.498962 20655 webserver.cc:460] Webserver started at http://127.12.145.62:46765/ using document root <none> and password file <none>
I20260811 06:49:28.499663 20655 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:28.499758 20655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:28.500078 20655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:28.503093 20655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "6ce5260ba223497eab77b10de626746c"
format_stamp: "Formatted at 2026-08-11 06:49:28 on dist-test-slave-7lbf"
server_key: "55627f81c26c6ff2349a91a7962c950e"
server_key_iv: "3efc482a77ff93cd98a98671d32eab28"
server_key_version: "encryptionkey@0"
I20260811 06:49:28.504019 20655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "6ce5260ba223497eab77b10de626746c"
format_stamp: "Formatted at 2026-08-11 06:49:28 on dist-test-slave-7lbf"
server_key: "55627f81c26c6ff2349a91a7962c950e"
server_key_iv: "3efc482a77ff93cd98a98671d32eab28"
server_key_version: "encryptionkey@0"
I20260811 06:49:28.509451 20655 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 06:49:28.513309 20677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:28.514809 20655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:28.514997 20655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "6ce5260ba223497eab77b10de626746c"
format_stamp: "Formatted at 2026-08-11 06:49:28 on dist-test-slave-7lbf"
server_key: "55627f81c26c6ff2349a91a7962c950e"
server_key_iv: "3efc482a77ff93cd98a98671d32eab28"
server_key_version: "encryptionkey@0"
I20260811 06:49:28.515218 20655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:28.520965 20655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:28.521827 20655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:28.522121 20655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:28.538674 20655 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:39491
I20260811 06:49:28.538697 20763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:39491 every 8 connection(s)
I20260811 06:49:28.540052 20655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:28.543221 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 20655
I20260811 06:49:28.543429 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:28.543870 20764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:28.544077 12868 external_mini_cluster.cc:1428] Setting key 7f4855abe84645d81eb0bb8dbc06bf24
I20260811 06:49:28.553220 20767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:28.546085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33456 (local address 127.12.145.62:39491)
0811 06:49:28.547220 (+ 1135us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:28.547235 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:28.547292 (+ 57us) server_negotiation.cc:407] Connection header received
0811 06:49:28.549042 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:28.549077 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:28.549694 (+ 617us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:28.550171 (+ 477us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:28.551219 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:28.551231 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:28.551248 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:28.551266 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:28.551341 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:28.551368 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:28.551592 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:28.551743 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 06:49:28.552039 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":350,"threads_started":1}
I20260811 06:49:28.558490 20764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c: Bootstrap starting.
I20260811 06:49:28.561718 20764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:28.562670 20764 log.cc:824] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:28.565408 20764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c: No bootstrap required, opened a new log
I20260811 06:49:28.572603 20764 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5260ba223497eab77b10de626746c" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39491 } }
I20260811 06:49:28.572940 20764 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:28.573012 20764 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ce5260ba223497eab77b10de626746c, State: Initialized, Role: FOLLOWER
I20260811 06:49:28.573616 20764 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5260ba223497eab77b10de626746c" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39491 } }
I20260811 06:49:28.573825 20764 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:28.573921 20764 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:28.574050 20764 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:28.576433 20764 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5260ba223497eab77b10de626746c" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39491 } }
I20260811 06:49:28.576915 20764 leader_election.cc:302] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ce5260ba223497eab77b10de626746c; no voters:
I20260811 06:49:28.577438 20764 leader_election.cc:288] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:28.577612 20770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:28.578300 20770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [term 1 LEADER]: Becoming Leader. State: Replica: 6ce5260ba223497eab77b10de626746c, State: Running, Role: LEADER
I20260811 06:49:28.578842 20770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5260ba223497eab77b10de626746c" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39491 } }
I20260811 06:49:28.579471 20764 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:28.581708 20775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ce5260ba223497eab77b10de626746c. Latest consensus state: current_term: 1 leader_uuid: "6ce5260ba223497eab77b10de626746c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5260ba223497eab77b10de626746c" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39491 } } }
I20260811 06:49:28.581764 20773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ce5260ba223497eab77b10de626746c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ce5260ba223497eab77b10de626746c" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39491 } } }
I20260811 06:49:28.582121 20775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:28.582126 20773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:28.585141 20784 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:28.590385 20784 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:28.598834 20784 catalog_manager.cc:1347] Generated new cluster ID: 1af60b75a19b43ab8bbe6d713b93069a
I20260811 06:49:28.598964 20784 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:28.620008 20784 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:28.620517 20784 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:28.641081 20784 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c: Generated new TSK 0
I20260811 06:49:28.642294 20784 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:49:28.651726 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:39491
--builtin_ntp_servers=127.12.145.20:40263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 06:49:28.986164 20801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:28.986444 20801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:28.986542 20801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:28.993800 20801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:28.993906 20801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:28.994016 20801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:49:29.003315 20801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:40263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:39491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:29.004606 20801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:29.006565 20801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:29.019496 20807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:29.019461 20808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:29.019529 20816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:29.020972 20801 server_base.cc:1034] running on GCE node
I20260811 06:49:29.021613 20801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:29.022644 20801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:29.023883 20801 hybrid_clock.cc:648] HybridClock initialized: now 1786430969023832 us; error 40 us; skew 500 ppm
I20260811 06:49:29.024214 20801 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:49:29.026598 20801 webserver.cc:460] Webserver started at http://127.12.145.1:39395/ using document root <none> and password file <none>
I20260811 06:49:29.027285 20801 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:29.027393 20801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:29.027720 20801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:29.030719 20801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "7e5803399a2849b1932f530aaeb63187"
format_stamp: "Formatted at 2026-08-11 06:49:29 on dist-test-slave-7lbf"
server_key: "6d7a70c6280df24fa35b7188efa0f92d"
server_key_iv: "2f4da6d127e5aa4d98047c3752097bf9"
server_key_version: "encryptionkey@0"
I20260811 06:49:29.031589 20801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "7e5803399a2849b1932f530aaeb63187"
format_stamp: "Formatted at 2026-08-11 06:49:29 on dist-test-slave-7lbf"
server_key: "6d7a70c6280df24fa35b7188efa0f92d"
server_key_iv: "2f4da6d127e5aa4d98047c3752097bf9"
server_key_version: "encryptionkey@0"
I20260811 06:49:29.036862 20801 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260811 06:49:29.040249 20824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:29.041648 20801 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:29.041793 20801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "7e5803399a2849b1932f530aaeb63187"
format_stamp: "Formatted at 2026-08-11 06:49:29 on dist-test-slave-7lbf"
server_key: "6d7a70c6280df24fa35b7188efa0f92d"
server_key_iv: "2f4da6d127e5aa4d98047c3752097bf9"
server_key_version: "encryptionkey@0"
I20260811 06:49:29.041994 20801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:29.047549 20801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:29.048300 20801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:29.048558 20801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:29.049404 20801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:29.050773 20801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:29.050868 20801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:29.050972 20801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:29.051038 20801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:29.082080 20801 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:35775
I20260811 06:49:29.082152 21029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:35775 every 8 connection(s)
I20260811 06:49:29.083439 20801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:49:29.084102 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 20801
I20260811 06:49:29.084350 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:49:29.085177 12868 external_mini_cluster.cc:1428] Setting key 47505aec0227d86589715ba2c58ad307
I20260811 06:49:29.088639 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:39491
--builtin_ntp_servers=127.12.145.20:40263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 06:49:29.092392 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:29.086443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:47613 (local address 127.12.145.62:39491)
0811 06:49:29.086941 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:29.086947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:29.088394 (+ 1447us) server_negotiation.cc:407] Connection header received
0811 06:49:29.090152 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:29.090158 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:29.090224 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:29.090371 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:29.091631 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:29.091636 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:29.091641 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:29.091661 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:29.091717 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:29.091734 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:29.091878 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:29.092001 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 06:49:29.092067 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":247,"threads_started":1}
I20260811 06:49:29.093220 21034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:29.087093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:39491 (local address 127.12.145.1:47613)
0811 06:49:29.088223 (+ 1130us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:29.088268 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:29.089871 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:29.090568 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:29.090576 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:29.090668 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:29.091326 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:49:29.091329 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:29.091367 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:49:29.091458 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:29.091828 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:29.091834 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:29.091840 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 06:49:29.092056 (+ 216us) client_negotiation.cc:240] Negotiation successful
0811 06:49:29.092253 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":316,"threads_started":1}
I20260811 06:49:29.094836 21030 heartbeater.cc:347] Connected to a master server at 127.12.145.62:39491
I20260811 06:49:29.095196 21030 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:29.095959 21030 heartbeater.cc:511] Master 127.12.145.62:39491 requested a full tablet report, sending...
I20260811 06:49:29.098570 20704 ts_manager.cc:194] Registered new tserver with Master: 7e5803399a2849b1932f530aaeb63187 (127.12.145.1:35775)
W20260811 06:49:29.426924 21035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:29.427235 21035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:29.427345 21035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:29.435573 21035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:29.435696 21035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:29.435835 21035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:49:29.445348 21035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:40263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:39491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:29.446750 21035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:29.448612 21035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:29.462037 21045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:29.462064 21048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:29.461994 21044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:29.467056 21035 server_base.cc:1034] running on GCE node
I20260811 06:49:29.467712 21035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:29.468720 21035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:29.469910 21035 hybrid_clock.cc:648] HybridClock initialized: now 1786430969469848 us; error 51 us; skew 500 ppm
I20260811 06:49:29.470232 21035 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:49:29.472594 21035 webserver.cc:460] Webserver started at http://127.12.145.2:44169/ using document root <none> and password file <none>
I20260811 06:49:29.473302 21035 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:29.473398 21035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:29.473793 21035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:29.476897 21035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "449dd07ce13e486ca3ef6369d4da3374"
format_stamp: "Formatted at 2026-08-11 06:49:29 on dist-test-slave-7lbf"
server_key: "79a98aec56f11cc3fef7cb3e15210185"
server_key_iv: "2579c7177c8184634f9ee076c4ffc8c2"
server_key_version: "encryptionkey@0"
I20260811 06:49:29.477845 21035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "449dd07ce13e486ca3ef6369d4da3374"
format_stamp: "Formatted at 2026-08-11 06:49:29 on dist-test-slave-7lbf"
server_key: "79a98aec56f11cc3fef7cb3e15210185"
server_key_iv: "2579c7177c8184634f9ee076c4ffc8c2"
server_key_version: "encryptionkey@0"
I20260811 06:49:29.483500 21035 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:49:29.487095 21059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:29.488458 21035 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:49:29.488620 21035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "449dd07ce13e486ca3ef6369d4da3374"
format_stamp: "Formatted at 2026-08-11 06:49:29 on dist-test-slave-7lbf"
server_key: "79a98aec56f11cc3fef7cb3e15210185"
server_key_iv: "2579c7177c8184634f9ee076c4ffc8c2"
server_key_version: "encryptionkey@0"
I20260811 06:49:29.488824 21035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:29.494611 21035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:29.495391 21035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:29.495651 21035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:29.496595 21035 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:29.498067 21035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:29.498167 21035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:29.498275 21035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:29.498344 21035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:29.530155 21035 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:37945
I20260811 06:49:29.530212 21260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:37945 every 8 connection(s)
I20260811 06:49:29.531579 21035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:49:29.533716 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 21035
I20260811 06:49:29.533895 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:49:29.534446 12868 external_mini_cluster.cc:1428] Setting key 5383a0c67cdb36e9d4dde1143f0b2baf
I20260811 06:49:29.537674 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:39491
--builtin_ntp_servers=127.12.145.20:40263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 06:49:29.541043 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:29.534218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:53887 (local address 127.12.145.62:39491)
0811 06:49:29.534455 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:29.534461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:29.536010 (+ 1549us) server_negotiation.cc:407] Connection header received
0811 06:49:29.538339 (+ 2329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:29.538346 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:29.538419 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:29.538535 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:29.540248 (+ 1713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:29.540254 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:29.540259 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:29.540280 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:29.540320 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:29.540334 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:29.540495 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:29.540684 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 06:49:29.540747 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 06:49:29.542248 21265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:29.534816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:39491 (local address 127.12.145.2:53887)
0811 06:49:29.535864 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:29.535901 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:29.538008 (+ 2107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:29.538801 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:29.538814 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:29.538942 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:29.539894 (+ 952us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:49:29.539898 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:29.539950 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:49:29.540064 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:29.540475 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:29.540485 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:29.540492 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 06:49:29.540760 (+ 268us) client_negotiation.cc:240] Negotiation successful
0811 06:49:29.541026 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":337,"threads_started":1}
I20260811 06:49:29.543694 21261 heartbeater.cc:347] Connected to a master server at 127.12.145.62:39491
I20260811 06:49:29.544027 21261 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:29.544734 21261 heartbeater.cc:511] Master 127.12.145.62:39491 requested a full tablet report, sending...
I20260811 06:49:29.546433 20704 ts_manager.cc:194] Registered new tserver with Master: 449dd07ce13e486ca3ef6369d4da3374 (127.12.145.2:37945)
W20260811 06:49:29.871922 21267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:29.872229 21267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:29.872378 21267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:29.879791 21267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:29.879912 21267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:29.880088 21267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:49:29.889675 21267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:40263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:39491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:29.891036 21267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:29.892864 21267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:29.905900 21274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:29.905818 21279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:29.905865 21276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:29.906816 21267 server_base.cc:1034] running on GCE node
I20260811 06:49:29.907423 21267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:29.908381 21267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:29.909639 21267 hybrid_clock.cc:648] HybridClock initialized: now 1786430969909585 us; error 39 us; skew 500 ppm
I20260811 06:49:29.909965 21267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:49:29.912231 21267 webserver.cc:460] Webserver started at http://127.12.145.3:45785/ using document root <none> and password file <none>
I20260811 06:49:29.912976 21267 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:29.913067 21267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:29.913394 21267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:29.916244 21267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "295911770aa247c2bdd0de031bb45a30"
format_stamp: "Formatted at 2026-08-11 06:49:29 on dist-test-slave-7lbf"
server_key: "fe04234d310d3d70bc63b4685b45198a"
server_key_iv: "665766eab3468e0e4bbcb561a12e22a2"
server_key_version: "encryptionkey@0"
I20260811 06:49:29.917014 21267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "295911770aa247c2bdd0de031bb45a30"
format_stamp: "Formatted at 2026-08-11 06:49:29 on dist-test-slave-7lbf"
server_key: "fe04234d310d3d70bc63b4685b45198a"
server_key_iv: "665766eab3468e0e4bbcb561a12e22a2"
server_key_version: "encryptionkey@0"
I20260811 06:49:29.922384 21267 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 06:49:29.925915 21291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:29.927325 21267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:49:29.927495 21267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "295911770aa247c2bdd0de031bb45a30"
format_stamp: "Formatted at 2026-08-11 06:49:29 on dist-test-slave-7lbf"
server_key: "fe04234d310d3d70bc63b4685b45198a"
server_key_iv: "665766eab3468e0e4bbcb561a12e22a2"
server_key_version: "encryptionkey@0"
I20260811 06:49:29.927714 21267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:29.933290 21267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:29.934131 21267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:29.934386 21267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:29.935272 21267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:29.936650 21267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:29.936753 21267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:29.936854 21267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:29.936923 21267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:29.966199 21267 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:41383
I20260811 06:49:29.966261 21472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:41383 every 8 connection(s)
I20260811 06:49:29.967603 21267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:49:29.972882 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 21267
I20260811 06:49:29.973073 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:49:29.973632 12868 external_mini_cluster.cc:1428] Setting key d42e09671b27175a96499e42716f33a0
I20260811 06:49:29.976807 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:29.970076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:55003 (local address 127.12.145.62:39491)
0811 06:49:29.970247 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:29.970252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:29.971698 (+ 1446us) server_negotiation.cc:407] Connection header received
0811 06:49:29.973810 (+ 2112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:29.973816 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:29.973876 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:29.973963 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:29.975309 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:29.975313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:29.975317 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:29.975332 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:29.975365 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:29.975376 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:29.975494 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:29.976488 (+ 994us) server_negotiation.cc:299] Negotiation successful
0811 06:49:29.976549 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 06:49:29.977193 21478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:29.970586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:39491 (local address 127.12.145.3:55003)
0811 06:49:29.971538 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:29.971573 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:29.973477 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:29.974227 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:29.974235 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:29.974337 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:29.974971 (+ 634us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:49:29.974974 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:29.975026 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:49:29.975139 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:29.975485 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:29.975496 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:29.975504 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 06:49:29.975773 (+ 269us) client_negotiation.cc:240] Negotiation successful
0811 06:49:29.976057 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":265,"threads_started":1}
I20260811 06:49:29.978382 21473 heartbeater.cc:347] Connected to a master server at 127.12.145.62:39491
I20260811 06:49:29.978663 21473 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:29.979233 21473 heartbeater.cc:511] Master 127.12.145.62:39491 requested a full tablet report, sending...
I20260811 06:49:29.980507 20704 ts_manager.cc:194] Registered new tserver with Master: 295911770aa247c2bdd0de031bb45a30 (127.12.145.3:41383)
I20260811 06:49:29.988768 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:49:29.995250 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:29.993078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33468 (local address 127.12.145.62:39491)
0811 06:49:29.993277 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:29.993284 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:29.993740 (+ 456us) server_negotiation.cc:407] Connection header received
0811 06:49:29.993876 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:29.993880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:29.993935 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:29.994017 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:29.994762 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:29.994766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:29.994769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:29.994783 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:29.994813 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:29.994825 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:29.994916 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:29.994948 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 06:49:29.995002 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 06:49:29.998930 20704 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33468:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:49:30.005669 20704 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:49:30.048532 21497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.017365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35775 (local address 127.0.0.1:46644)
0811 06:49:30.043048 (+ 25683us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.043103 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:30.043311 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:30.045738 (+ 2427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:30.045748 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:30.045850 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:30.047177 (+ 1327us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:49:30.047181 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:30.047211 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:49:30.047296 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:30.047783 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:30.047796 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:30.047804 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 06:49:30.047977 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 06:49:30.048071 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25349,"thread_start_us":29438,"threads_started":1}
I20260811 06:49:30.048763 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.018099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59776 (local address 127.12.145.3:41383)
0811 06:49:30.044384 (+ 26285us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:30.044394 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:30.044886 (+ 492us) server_negotiation.cc:407] Connection header received
0811 06:49:30.044978 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:30.044987 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:30.045238 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:30.045466 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:30.047554 (+ 2088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:30.047562 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:30.047572 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:30.047590 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:30.047640 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:30.047661 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:30.047833 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:30.048293 (+ 460us) server_negotiation.cc:299] Negotiation successful
0811 06:49:30.048399 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26065,"thread_start_us":26300,"threads_started":1}
I20260811 06:49:30.049088 21494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.017544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:41383 (local address 127.0.0.1:59776)
0811 06:49:30.044625 (+ 27081us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.044644 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:30.044759 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:30.045792 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:30.045798 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:30.045851 (+ 53us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:30.047336 (+ 1485us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:49:30.047339 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:30.047356 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:49:30.047397 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:30.047885 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:30.047889 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:30.047894 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 06:49:30.048014 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 06:49:30.048078 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26946,"thread_start_us":26792,"threads_started":1}
I20260811 06:49:30.049638 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.017623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46644 (local address 127.12.145.1:35775)
0811 06:49:30.045027 (+ 27404us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:30.045065 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:30.045098 (+ 33us) server_negotiation.cc:407] Connection header received
0811 06:49:30.045176 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:30.045184 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:30.045434 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:30.046536 (+ 1102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:30.047464 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:30.047472 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:30.047487 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:30.047512 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:30.047568 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:30.047589 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:30.047723 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:30.049198 (+ 1475us) server_negotiation.cc:299] Negotiation successful
0811 06:49:30.049300 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27210,"thread_start_us":27080,"threads_started":1}
I20260811 06:49:30.051450 21499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.018710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60218 (local address 127.12.145.2:37945)
0811 06:49:30.042094 (+ 23384us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:30.042106 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:30.047178 (+ 5072us) server_negotiation.cc:407] Connection header received
0811 06:49:30.047260 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:30.047269 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:30.047490 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:30.047623 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:30.050507 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:30.050517 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:30.050530 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:30.050578 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:30.050637 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:30.050657 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:30.050762 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:30.051031 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 06:49:30.051131 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23131,"thread_start_us":23405,"threads_started":1}
I20260811 06:49:30.052146 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.017997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:37945 (local address 127.0.0.1:60218)
0811 06:49:30.047042 (+ 29045us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.047056 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:30.047159 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:30.048696 (+ 1537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:30.048701 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:30.048721 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:30.050265 (+ 1544us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:49:30.050268 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:30.050284 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:49:30.050327 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:30.050869 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:30.050873 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:30.050877 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 06:49:30.051705 (+ 828us) client_negotiation.cc:240] Negotiation successful
0811 06:49:30.051758 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28923,"thread_start_us":25483,"threads_started":1}
I20260811 06:49:30.053009 21370 tablet_service.cc:1467] Processing CreateTablet for tablet a0e7819a2a224290b7ce7ec27af29600 (DEFAULT_TABLE table=test-table [id=5ccc5a4877c04e00a90551f0719c6643]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:30.053073 20917 tablet_service.cc:1467] Processing CreateTablet for tablet a0e7819a2a224290b7ce7ec27af29600 (DEFAULT_TABLE table=test-table [id=5ccc5a4877c04e00a90551f0719c6643]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:30.054561 21370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e7819a2a224290b7ce7ec27af29600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:30.054577 20917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e7819a2a224290b7ce7ec27af29600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:30.055665 21157 tablet_service.cc:1467] Processing CreateTablet for tablet a0e7819a2a224290b7ce7ec27af29600 (DEFAULT_TABLE table=test-table [id=5ccc5a4877c04e00a90551f0719c6643]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:30.056998 21157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e7819a2a224290b7ce7ec27af29600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:30.066326 21500 tablet_bootstrap.cc:492] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187: Bootstrap starting.
I20260811 06:49:30.068761 21502 tablet_bootstrap.cc:492] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: Bootstrap starting.
I20260811 06:49:30.070896 21503 tablet_bootstrap.cc:492] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: Bootstrap starting.
I20260811 06:49:30.071336 21500 tablet_bootstrap.cc:654] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:30.072465 21502 tablet_bootstrap.cc:654] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:30.072708 21500 log.cc:824] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:30.073758 21502 log.cc:824] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:30.074154 21503 tablet_bootstrap.cc:654] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:30.075404 21503 log.cc:824] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:30.076025 21500 tablet_bootstrap.cc:492] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187: No bootstrap required, opened a new log
I20260811 06:49:30.076375 21500 ts_tablet_manager.cc:1397] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 06:49:30.076818 21502 tablet_bootstrap.cc:492] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: No bootstrap required, opened a new log
I20260811 06:49:30.077162 21502 ts_tablet_manager.cc:1397] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260811 06:49:30.078271 21503 tablet_bootstrap.cc:492] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: No bootstrap required, opened a new log
I20260811 06:49:30.078500 21503 ts_tablet_manager.cc:1397] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260811 06:49:30.086687 21503 raft_consensus.cc:348] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5803399a2849b1932f530aaeb63187" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35775 } } peers { permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 } } peers { permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 } }
I20260811 06:49:30.087304 21503 raft_consensus.cc:374] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:30.087481 21503 raft_consensus.cc:729] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 449dd07ce13e486ca3ef6369d4da3374, State: Initialized, Role: FOLLOWER
I20260811 06:49:30.087530 21502 raft_consensus.cc:348] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5803399a2849b1932f530aaeb63187" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35775 } } peers { permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 } } peers { permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 } }
I20260811 06:49:30.087530 21500 raft_consensus.cc:348] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5803399a2849b1932f530aaeb63187" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35775 } } peers { permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 } } peers { permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 } }
I20260811 06:49:30.087996 21500 raft_consensus.cc:374] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:30.088084 21502 raft_consensus.cc:374] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:30.088155 21500 raft_consensus.cc:729] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5803399a2849b1932f530aaeb63187, State: Initialized, Role: FOLLOWER
I20260811 06:49:30.088227 21502 raft_consensus.cc:729] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295911770aa247c2bdd0de031bb45a30, State: Initialized, Role: FOLLOWER
I20260811 06:49:30.088480 21503 consensus_queue.cc:260] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5803399a2849b1932f530aaeb63187" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35775 } } peers { permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 } } peers { permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 } }
I20260811 06:49:30.088814 21500 consensus_queue.cc:260] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5803399a2849b1932f530aaeb63187" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35775 } } peers { permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 } } peers { permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 } }
I20260811 06:49:30.089053 21502 consensus_queue.cc:260] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5803399a2849b1932f530aaeb63187" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35775 } } peers { permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 } } peers { permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 } }
I20260811 06:49:30.094365 21500 ts_tablet_manager.cc:1428] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
I20260811 06:49:30.094839 21030 heartbeater.cc:503] Master 127.12.145.62:39491 was elected leader, sending a full tablet report...
I20260811 06:49:30.098137 21473 heartbeater.cc:503] Master 127.12.145.62:39491 was elected leader, sending a full tablet report...
I20260811 06:49:30.098237 21503 ts_tablet_manager.cc:1428] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: Time spent starting tablet: real 0.020s user 0.003s sys 0.016s
I20260811 06:49:30.098779 21502 ts_tablet_manager.cc:1428] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: Time spent starting tablet: real 0.021s user 0.012s sys 0.008s
I20260811 06:49:30.099417 21261 heartbeater.cc:503] Master 127.12.145.62:39491 was elected leader, sending a full tablet report...
I20260811 06:49:30.100201 21513 raft_consensus.cc:482] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:30.100684 21513 raft_consensus.cc:504] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5803399a2849b1932f530aaeb63187" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35775 } } peers { permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 } } peers { permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 } }
I20260811 06:49:30.102876 21513 leader_election.cc:288] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 295911770aa247c2bdd0de031bb45a30 (127.12.145.3:41383), 449dd07ce13e486ca3ef6369d4da3374 (127.12.145.2:37945)
I20260811 06:49:30.106441 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.103170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:42293 (local address 127.12.145.3:41383)
0811 06:49:30.103336 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:30.103342 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:30.104079 (+ 737us) server_negotiation.cc:407] Connection header received
0811 06:49:30.104324 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:30.104330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:30.104396 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:30.104466 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:30.105801 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:30.105815 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:30.105820 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:30.105841 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:30.105882 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:30.105898 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:30.106023 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:30.106136 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 06:49:30.106200 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 06:49:30.106640 21518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.102966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:41383 (local address 127.12.145.1:42293)
0811 06:49:30.103973 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.103993 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:30.104171 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:30.104693 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:30.104698 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:30.104730 (+ 32us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:30.105582 (+ 852us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:49:30.105585 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:30.105604 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:49:30.105655 (+ 51us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:30.106013 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:30.106018 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:30.106024 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 06:49:30.106158 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 06:49:30.106209 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":797,"thread_start_us":539,"threads_started":1}
I20260811 06:49:30.107241 21499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.103290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:55781 (local address 127.12.145.2:37945)
0811 06:49:30.103478 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:30.103535 (+ 57us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:30.105216 (+ 1681us) server_negotiation.cc:407] Connection header received
0811 06:49:30.105335 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:30.105340 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:30.105398 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:30.105487 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:30.106572 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:30.106577 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:30.106582 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:30.106601 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:30.106640 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:30.106654 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:30.106732 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:30.106946 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 06:49:30.107007 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 06:49:30.107604 21404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e7819a2a224290b7ce7ec27af29600" candidate_uuid: "7e5803399a2849b1932f530aaeb63187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295911770aa247c2bdd0de031bb45a30" is_pre_election: true
I20260811 06:49:30.107906 21519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.103960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:37945 (local address 127.12.145.1:55781)
0811 06:49:30.105120 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.105139 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:30.105239 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:30.105612 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:30.105617 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:30.105640 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:30.106322 (+ 682us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:49:30.106326 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:30.106346 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:49:30.106400 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:30.106816 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:30.106821 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:30.106826 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 06:49:30.107512 (+ 686us) client_negotiation.cc:240] Negotiation successful
0811 06:49:30.107553 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1026,"thread_start_us":798,"threads_started":1}
I20260811 06:49:30.108157 21404 raft_consensus.cc:2454] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5803399a2849b1932f530aaeb63187 in term 0.
I20260811 06:49:30.108806 20829 leader_election.cc:302] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295911770aa247c2bdd0de031bb45a30, 7e5803399a2849b1932f530aaeb63187; no voters:
I20260811 06:49:30.108894 21185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e7819a2a224290b7ce7ec27af29600" candidate_uuid: "7e5803399a2849b1932f530aaeb63187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "449dd07ce13e486ca3ef6369d4da3374" is_pre_election: true
I20260811 06:49:30.109232 21513 raft_consensus.cc:2781] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:49:30.109380 21513 raft_consensus.cc:482] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:49:30.109478 21513 raft_consensus.cc:3037] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:30.109395 21185 raft_consensus.cc:2454] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5803399a2849b1932f530aaeb63187 in term 0.
I20260811 06:49:30.111910 21513 raft_consensus.cc:504] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5803399a2849b1932f530aaeb63187" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35775 } } peers { permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 } } peers { permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 } }
I20260811 06:49:30.112533 21513 leader_election.cc:288] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [CANDIDATE]: Term 1 election: Requested vote from peers 295911770aa247c2bdd0de031bb45a30 (127.12.145.3:41383), 449dd07ce13e486ca3ef6369d4da3374 (127.12.145.2:37945)
I20260811 06:49:30.113046 21404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e7819a2a224290b7ce7ec27af29600" candidate_uuid: "7e5803399a2849b1932f530aaeb63187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295911770aa247c2bdd0de031bb45a30"
I20260811 06:49:30.113111 21185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e7819a2a224290b7ce7ec27af29600" candidate_uuid: "7e5803399a2849b1932f530aaeb63187" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "449dd07ce13e486ca3ef6369d4da3374"
I20260811 06:49:30.113282 21185 raft_consensus.cc:3037] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:30.113270 21404 raft_consensus.cc:3037] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:30.115649 21185 raft_consensus.cc:2454] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5803399a2849b1932f530aaeb63187 in term 1.
I20260811 06:49:30.115670 21404 raft_consensus.cc:2454] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5803399a2849b1932f530aaeb63187 in term 1.
I20260811 06:49:30.116029 20832 leader_election.cc:302] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 449dd07ce13e486ca3ef6369d4da3374, 7e5803399a2849b1932f530aaeb63187; no voters:
I20260811 06:49:30.116333 21513 raft_consensus.cc:2781] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:30.116747 21513 raft_consensus.cc:686] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 1 LEADER]: Becoming Leader. State: Replica: 7e5803399a2849b1932f530aaeb63187, State: Running, Role: LEADER
I20260811 06:49:30.117295 21513 consensus_queue.cc:237] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5803399a2849b1932f530aaeb63187" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35775 } } peers { permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 } } peers { permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 } }
I20260811 06:49:30.121812 20703 catalog_manager.cc:5495] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5803399a2849b1932f530aaeb63187 (127.12.145.1). New cstate: current_term: 1 leader_uuid: "7e5803399a2849b1932f530aaeb63187" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5803399a2849b1932f530aaeb63187" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 } health_report { overall_health: UNKNOWN } } }
I20260811 06:49:30.138125 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.136371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46646 (local address 127.12.145.1:35775)
0811 06:49:30.136523 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:30.136528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:30.136544 (+ 16us) server_negotiation.cc:407] Connection header received
0811 06:49:30.136689 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:30.136693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:30.136771 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:30.136863 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:30.137625 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:30.137629 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:30.137632 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:30.137646 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:30.137677 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:30.137688 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:30.137774 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:30.137863 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 06:49:30.137909 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 06:49:30.146284 21404 raft_consensus.cc:1261] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30 [term 1 FOLLOWER]: Refusing update from remote peer 7e5803399a2849b1932f530aaeb63187: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:30.146287 21185 raft_consensus.cc:1261] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374 [term 1 FOLLOWER]: Refusing update from remote peer 7e5803399a2849b1932f530aaeb63187: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:30.147220 21513 consensus_queue.cc:1035] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295911770aa247c2bdd0de031bb45a30" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:30.147516 21520 consensus_queue.cc:1035] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [LEADER]: Connected to new peer: Peer: permanent_uuid: "449dd07ce13e486ca3ef6369d4da3374" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:30.159982 21530 mvcc.cc:205] Tried to move back new op lower bound from 7317221253708943360 to 7317221253604470784. Current Snapshot: MvccSnapshot[applied={T|T < 7317221253708943360}]
I20260811 06:49:30.172716 20703 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:30.172989 20703 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:30.176468 20703 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ce5260ba223497eab77b10de626746c: Sending DeleteTablet for 3 replicas of tablet a0e7819a2a224290b7ce7ec27af29600
I20260811 06:49:30.177654 20917 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e7819a2a224290b7ce7ec27af29600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:30 UTC) from {username='slave'} at 127.0.0.1:46644
I20260811 06:49:30.177706 21370 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e7819a2a224290b7ce7ec27af29600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:30 UTC) from {username='slave'} at 127.0.0.1:59776
I20260811 06:49:30.178004 21157 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e7819a2a224290b7ce7ec27af29600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:30 UTC) from {username='slave'} at 127.0.0.1:60218
I20260811 06:49:30.180024 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 20801
I20260811 06:49:30.193176 21546 tablet_replica.cc:330] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: stopping tablet replica
I20260811 06:49:30.193861 21546 raft_consensus.cc:2229] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:30.194612 21546 raft_consensus.cc:2258] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:30.195333 21543 tablet_replica.cc:330] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187: stopping tablet replica
I20260811 06:49:30.196152 21543 raft_consensus.cc:2229] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:49:30.196251 21544 tablet_replica.cc:330] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: stopping tablet replica
I20260811 06:49:30.196676 21544 raft_consensus.cc:2229] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:30.197185 21544 raft_consensus.cc:2258] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:30.198216 21543 raft_consensus.cc:2258] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:30.198377 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.181234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46650 (local address 127.12.145.1:35775)
0811 06:49:30.181404 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:30.181411 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:30.195567 (+ 14156us) server_negotiation.cc:407] Connection header received
0811 06:49:30.195835 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:30.195841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:30.195911 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:30.196020 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:30.197232 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:30.197238 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:30.197242 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:30.197263 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:30.197304 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:30.197320 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:30.197431 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:30.198000 (+ 569us) server_negotiation.cc:299] Negotiation successful
0811 06:49:30.198073 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 06:49:30.198613 21546 ts_tablet_manager.cc:1905] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:30.199841 21024 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:30.201248 21544 ts_tablet_manager.cc:1905] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:30.205717 21546 ts_tablet_manager.cc:1918] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:49:30.205909 21546 log.cc:1196] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/a0e7819a2a224290b7ce7ec27af29600
I20260811 06:49:30.206550 21546 ts_tablet_manager.cc:1939] T a0e7819a2a224290b7ce7ec27af29600 P 449dd07ce13e486ca3ef6369d4da3374: Deleting consensus metadata
I20260811 06:49:30.208189 21544 ts_tablet_manager.cc:1918] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:49:30.208352 21544 log.cc:1196] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/a0e7819a2a224290b7ce7ec27af29600
I20260811 06:49:30.208765 20681 catalog_manager.cc:4841] TS 449dd07ce13e486ca3ef6369d4da3374 (127.12.145.2:37945): tablet a0e7819a2a224290b7ce7ec27af29600 (table test-table [id=5ccc5a4877c04e00a90551f0719c6643]) successfully deleted
I20260811 06:49:30.208874 21544 ts_tablet_manager.cc:1939] T a0e7819a2a224290b7ce7ec27af29600 P 295911770aa247c2bdd0de031bb45a30: Deleting consensus metadata
I20260811 06:49:30.210366 20679 catalog_manager.cc:4841] TS 295911770aa247c2bdd0de031bb45a30 (127.12.145.3:41383): tablet a0e7819a2a224290b7ce7ec27af29600 (table test-table [id=5ccc5a4877c04e00a90551f0719c6643]) successfully deleted
I20260811 06:49:30.200693 21543 ts_tablet_manager.cc:1905] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:30.303613 21543 ts_tablet_manager.cc:1918] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:49:30.303819 21543 log.cc:1196] T a0e7819a2a224290b7ce7ec27af29600 P 7e5803399a2849b1932f530aaeb63187: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/a0e7819a2a224290b7ce7ec27af29600
I20260811 06:49:30.303956 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 20801
I20260811 06:49:30.324234 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 21035
W20260811 06:49:30.324244 20685 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.1:35775 (error 108)
I20260811 06:49:30.326184 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.325682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35775 (local address 127.0.0.1:46662)
0811 06:49:30.325842 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.326045 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 06:49:30.326402 20685 catalog_manager.cc:4584] TS 7e5803399a2849b1932f530aaeb63187 (127.12.145.1:35775): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a0e7819a2a224290b7ce7ec27af29600: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35775: connect: Connection refused (error 111)
I20260811 06:49:30.327641 21499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.325080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60228 (local address 127.12.145.2:37945)
0811 06:49:30.325252 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:30.325258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:30.325342 (+ 84us) server_negotiation.cc:407] Connection header received
0811 06:49:30.325548 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:30.325554 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:30.325656 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:30.325749 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:30.327019 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:30.327026 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:30.327029 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:30.327044 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:30.327076 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:30.327088 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:30.327201 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:30.327307 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 06:49:30.327368 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 06:49:30.328317 21254 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:30.380272 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.379616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35775 (local address 127.0.0.1:46670)
0811 06:49:30.379922 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.380057 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 06:49:30.381374 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.380975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35775 (local address 127.0.0.1:46674)
0811 06:49:30.381153 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.381243 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 06:49:30.416172 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 21035
I20260811 06:49:30.442715 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.442175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35775 (local address 127.0.0.1:46690)
0811 06:49:30.442409 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.442535 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 06:49:30.443938 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.443526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35775 (local address 127.0.0.1:46704)
0811 06:49:30.443665 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.443765 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 06:49:30.444151 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 21267
I20260811 06:49:30.446776 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.444941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59778 (local address 127.12.145.3:41383)
0811 06:49:30.445109 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:30.445114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:30.445132 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:49:30.445260 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:30.445264 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:30.445345 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:30.445427 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:30.446276 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:30.446281 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:30.446284 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:30.446299 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:30.446333 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:30.446344 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:30.446447 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:30.446515 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 06:49:30.446562 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:49:30.447479 21467 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:30.524844 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.524252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35775 (local address 127.0.0.1:46712)
0811 06:49:30.524506 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.524635 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260811 06:49:30.526087 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:30.525616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35775 (local address 127.0.0.1:46726)
0811 06:49:30.525873 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:30.525953 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260811 06:49:30.534915 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 21267
I20260811 06:49:30.561597 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 20655
I20260811 06:49:30.562788 20757 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:30.670342 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 20655
2026-08-11T06:49:30Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2616 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 06:49:30.720082 12868 mini_oidc.cc:152] Starting JWKS server
I20260811 06:49:30.723088 12868 webserver.cc:460] Webserver started at https://127.0.0.1:41331/ using document root <none> and password file <none>
I20260811 06:49:30.723412 12868 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 06:49:30.724045 12868 webserver.cc:460] Webserver started at http://127.0.0.1:39731/ using document root <none> and password file <none>
2026-08-11T06:49:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:30Z Disabled control of system clock
I20260811 06:49:30.755599 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:36097
--webserver_interface=127.12.145.62
--webserver_port=0
--builtin_ntp_servers=127.12.145.20:40575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:36097
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41331/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/testchainca.cert with env {}
W20260811 06:49:31.081838 21566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:31.082149 21566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:31.082280 21566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:31.089648 21566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:31.089780 21566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:31.089843 21566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:31.089920 21566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:31.089994 21566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 06:49:31.090087 21566 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 06:49:31.090137 21566 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41331/jwks.json
I20260811 06:49:31.100492 21566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:40575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:36097
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:36097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41331/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:31.101962 21566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:31.103277 21566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:31.115063 21579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:31.115041 21577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:31.115042 21576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:31.121594 21566 server_base.cc:1034] running on GCE node
I20260811 06:49:31.122493 21566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:31.124073 21566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:31.125281 21566 hybrid_clock.cc:648] HybridClock initialized: now 1786430971125227 us; error 55 us; skew 500 ppm
I20260811 06:49:31.125690 21566 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:49:31.128008 21566 webserver.cc:460] Webserver started at http://127.12.145.62:44003/ using document root <none> and password file <none>
I20260811 06:49:31.128710 21566 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:31.128818 21566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:31.129148 21566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:31.132254 21566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "a8ba97a5c6ee406280e8952362fc4967"
format_stamp: "Formatted at 2026-08-11 06:49:31 on dist-test-slave-7lbf"
server_key: "ea8e5144a876780af4b64d7ba44ad943"
server_key_iv: "97c5bedb57e6cfbf131a8eecbc26f032"
server_key_version: "encryptionkey@0"
I20260811 06:49:31.133075 21566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "a8ba97a5c6ee406280e8952362fc4967"
format_stamp: "Formatted at 2026-08-11 06:49:31 on dist-test-slave-7lbf"
server_key: "ea8e5144a876780af4b64d7ba44ad943"
server_key_iv: "97c5bedb57e6cfbf131a8eecbc26f032"
server_key_version: "encryptionkey@0"
I20260811 06:49:31.138594 21566 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 06:49:31.142175 21588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:31.143483 21566 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:31.143658 21566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "a8ba97a5c6ee406280e8952362fc4967"
format_stamp: "Formatted at 2026-08-11 06:49:31 on dist-test-slave-7lbf"
server_key: "ea8e5144a876780af4b64d7ba44ad943"
server_key_iv: "97c5bedb57e6cfbf131a8eecbc26f032"
server_key_version: "encryptionkey@0"
I20260811 06:49:31.143870 21566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:31.172914 21566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:31.173839 21566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:31.174146 21566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:31.191381 21566 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:36097
I20260811 06:49:31.191401 21682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:36097 every 8 connection(s)
I20260811 06:49:31.192713 21566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:31.195221 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 21566
I20260811 06:49:31.195397 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:31.196074 12868 external_mini_cluster.cc:1428] Setting key c0a47b6e825c5220de9c67518e60f369
I20260811 06:49:31.196648 21683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:31.211692 21686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:31.197960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35098 (local address 127.12.145.62:36097)
0811 06:49:31.199063 (+ 1103us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:31.199078 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:31.199129 (+ 51us) server_negotiation.cc:407] Connection header received
0811 06:49:31.201549 (+ 2420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:31.201580 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:31.202208 (+ 628us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:31.202672 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:31.203242 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:31.205242 (+ 2000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:31.206560 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:31.207590 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:31.207774 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:31.208835 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:31.208846 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:31.208864 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:31.209629 (+ 765us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:31.209726 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:31.209752 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:31.209869 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:31.210040 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 06:49:31.210375 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":322,"threads_started":1}
I20260811 06:49:31.211824 21683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967: Bootstrap starting.
I20260811 06:49:31.215267 21683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:31.215518 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:49:31.216317 21683 log.cc:824] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:31.219624 21683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967: No bootstrap required, opened a new log
I20260811 06:49:31.227273 21683 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba97a5c6ee406280e8952362fc4967" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36097 } }
I20260811 06:49:31.227639 21683 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:31.227737 21683 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ba97a5c6ee406280e8952362fc4967, State: Initialized, Role: FOLLOWER
I20260811 06:49:31.228341 21683 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba97a5c6ee406280e8952362fc4967" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36097 } }
I20260811 06:49:31.228566 21683 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:31.228693 21683 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:31.228840 21683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:31.231209 21683 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba97a5c6ee406280e8952362fc4967" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36097 } }
I20260811 06:49:31.231700 21683 leader_election.cc:302] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8ba97a5c6ee406280e8952362fc4967; no voters:
I20260811 06:49:31.232246 21683 leader_election.cc:288] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:31.232371 21689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:31.233031 21689 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [term 1 LEADER]: Becoming Leader. State: Replica: a8ba97a5c6ee406280e8952362fc4967, State: Running, Role: LEADER
I20260811 06:49:31.233620 21689 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba97a5c6ee406280e8952362fc4967" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36097 } }
I20260811 06:49:31.234266 21683 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:31.236171 21692 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8ba97a5c6ee406280e8952362fc4967" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba97a5c6ee406280e8952362fc4967" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36097 } } }
I20260811 06:49:31.236492 21692 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:31.236934 21693 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8ba97a5c6ee406280e8952362fc4967. Latest consensus state: current_term: 1 leader_uuid: "a8ba97a5c6ee406280e8952362fc4967" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8ba97a5c6ee406280e8952362fc4967" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36097 } } }
I20260811 06:49:31.237246 21693 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:31.237414 21703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:31.244109 21703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:31.253216 21703 catalog_manager.cc:1347] Generated new cluster ID: de8e5db148cd4bd88eaf54afb4625419
I20260811 06:49:31.253337 21703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:31.276937 21703 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:31.278882 21703 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:31.288193 21703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8ba97a5c6ee406280e8952362fc4967: Generated new TSK 0
I20260811 06:49:31.289258 21703 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 06:49:31.334039 21732 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 06:49:31.334374 21732 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 06:49:31.335393 21686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:31.310276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35112 (local address 127.12.145.62:36097)
0811 06:49:31.310486 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:31.310494 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:31.314162 (+ 3668us) server_negotiation.cc:407] Connection header received
0811 06:49:31.314572 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:31.314576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:31.314650 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:31.314784 (+ 134us) server_negotiation.cc:226] Negotiated authn=JWT
0811 06:49:31.315367 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:31.316113 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:31.317562 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:31.318011 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:31.318137 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:31.318688 (+ 551us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 06:49:31.334773 (+ 16085us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 06:49:31.335114 (+ 341us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35112: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 06:49:31.335525 21686 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35112: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 06:49:31.337811 21731 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:49:31.310268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36097 (local address 127.0.0.1:35112)
0811 06:49:31.314051 (+ 3783us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:31.314068 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:31.314258 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:31.314847 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:31.314853 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:31.314867 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0811 06:49:31.315209 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:31.315218 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:31.316271 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:31.316275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:31.317379 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:31.317391 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:31.318204 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:31.318211 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:31.318345 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:31.318404 (+ 59us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 06:49:31.335112 (+ 16708us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 06:49:31.335550 (+ 438us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.145.62:36097: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":3587,"thread_start_us":3438,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.145.62:36097: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 06:49:31.339668 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 21566
I20260811 06:49:31.340973 21669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:31.436842 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 21566
2026-08-11T06:49:31Z chronyd exiting
I20260811 06:49:31.490355 12868 test_util.cc:175] -----------------------------------------------
I20260811 06:49:31.490494 12868 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786430925511755-12868-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (775 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 06:49:31.494554 12868 mini_oidc.cc:152] Starting JWKS server
I20260811 06:49:31.496361 12868 webserver.cc:460] Webserver started at https://127.0.0.1:44883/ using document root <none> and password file <none>
I20260811 06:49:31.496610 12868 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 06:49:31.497256 12868 webserver.cc:460] Webserver started at http://127.0.0.1:35579/ using document root <none> and password file <none>
2026-08-11T06:49:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:31Z Disabled control of system clock
I20260811 06:49:31.529170 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:46551
--webserver_interface=127.12.145.62
--webserver_port=0
--builtin_ntp_servers=127.12.145.20:42129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:46551
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44883/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/testchainca.cert with env {}
W20260811 06:49:31.857067 21740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:31.857414 21740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:31.857589 21740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:31.865042 21740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:31.865167 21740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:31.865235 21740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:31.865314 21740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:31.865386 21740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 06:49:31.865474 21740 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 06:49:31.865549 21740 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44883/jwks.json
I20260811 06:49:31.876111 21740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:46551
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:46551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44883/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:31.877490 21740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:31.878878 21740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:31.890367 21748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:31.890407 21749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:31.890328 21751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:31.891969 21740 server_base.cc:1034] running on GCE node
I20260811 06:49:31.892773 21740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:31.894258 21740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:31.895471 21740 hybrid_clock.cc:648] HybridClock initialized: now 1786430971895423 us; error 38 us; skew 500 ppm
I20260811 06:49:31.895802 21740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:49:31.900694 21740 webserver.cc:460] Webserver started at http://127.12.145.62:38707/ using document root <none> and password file <none>
I20260811 06:49:31.901425 21740 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:31.901553 21740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:31.901904 21740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:31.904892 21740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "15f1339025c4401b84086fa30f84696d"
format_stamp: "Formatted at 2026-08-11 06:49:31 on dist-test-slave-7lbf"
server_key: "82c3c063b28383febd614dfc31f68f23"
server_key_iv: "5d455d43e9b87e81c5701cba459fd6e6"
server_key_version: "encryptionkey@0"
I20260811 06:49:31.905757 21740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "15f1339025c4401b84086fa30f84696d"
format_stamp: "Formatted at 2026-08-11 06:49:31 on dist-test-slave-7lbf"
server_key: "82c3c063b28383febd614dfc31f68f23"
server_key_iv: "5d455d43e9b87e81c5701cba459fd6e6"
server_key_version: "encryptionkey@0"
I20260811 06:49:31.911037 21740 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 06:49:31.914750 21759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:31.916167 21740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:31.916354 21740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "15f1339025c4401b84086fa30f84696d"
format_stamp: "Formatted at 2026-08-11 06:49:31 on dist-test-slave-7lbf"
server_key: "82c3c063b28383febd614dfc31f68f23"
server_key_iv: "5d455d43e9b87e81c5701cba459fd6e6"
server_key_version: "encryptionkey@0"
I20260811 06:49:31.916569 21740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:31.936836 21740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:31.937777 21740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:31.938093 21740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:31.955720 21740 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:46551
I20260811 06:49:31.955751 21849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:46551 every 8 connection(s)
I20260811 06:49:31.957139 21740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:31.960981 21851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:31.967406 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 21740
I20260811 06:49:31.967646 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:31.968504 12868 external_mini_cluster.cc:1428] Setting key a8e9ea4998a9a9d4974b67d61bdca509
I20260811 06:49:31.972330 21851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d: Bootstrap starting.
I20260811 06:49:31.975777 21851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:31.977007 21851 log.cc:824] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:31.980415 21851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d: No bootstrap required, opened a new log
I20260811 06:49:31.982537 21856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:31.970570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59886 (local address 127.12.145.62:46551)
0811 06:49:31.971564 (+ 994us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:31.971575 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:31.971620 (+ 45us) server_negotiation.cc:407] Connection header received
0811 06:49:31.973363 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:31.973395 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:31.973909 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:31.974242 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:31.974862 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:31.976243 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:31.978019 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:31.978861 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:31.979004 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:31.980208 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:31.980215 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:31.980229 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:31.980800 (+ 571us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:31.980886 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:31.980907 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:31.981002 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:31.981238 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 06:49:31.981583 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":341,"threads_started":1}
I20260811 06:49:31.986320 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:49:31.988245 21851 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1339025c4401b84086fa30f84696d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46551 } }
I20260811 06:49:31.988685 21851 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:31.988809 21851 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f1339025c4401b84086fa30f84696d, State: Initialized, Role: FOLLOWER
I20260811 06:49:31.989362 21851 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1339025c4401b84086fa30f84696d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46551 } }
I20260811 06:49:31.989661 21851 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:31.989801 21851 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:31.989964 21851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:31.992098 21851 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1339025c4401b84086fa30f84696d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46551 } }
I20260811 06:49:31.992595 21851 leader_election.cc:302] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15f1339025c4401b84086fa30f84696d; no voters:
I20260811 06:49:31.993162 21851 leader_election.cc:288] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:31.993341 21860 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:31.994264 21860 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [term 1 LEADER]: Becoming Leader. State: Replica: 15f1339025c4401b84086fa30f84696d, State: Running, Role: LEADER
I20260811 06:49:31.994777 21860 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1339025c4401b84086fa30f84696d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46551 } }
I20260811 06:49:31.995260 21851 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:31.997531 21862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15f1339025c4401b84086fa30f84696d. Latest consensus state: current_term: 1 leader_uuid: "15f1339025c4401b84086fa30f84696d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1339025c4401b84086fa30f84696d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46551 } } }
I20260811 06:49:31.997951 21862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:31.997743 21861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15f1339025c4401b84086fa30f84696d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1339025c4401b84086fa30f84696d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46551 } } }
I20260811 06:49:31.998090 21861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:32.001585 21874 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:32.005901 21874 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:32.014365 21874 catalog_manager.cc:1347] Generated new cluster ID: 33d7b2c92cba4d2485410cb069cd791e
I20260811 06:49:32.014479 21874 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:32.032955 21874 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:32.034305 21874 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:32.046654 21874 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15f1339025c4401b84086fa30f84696d: Generated new TSK 0
I20260811 06:49:32.047557 21874 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 06:49:32.096761 21900 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 06:49:32.096903 21900 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 06:49:32.098107 21856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:32.071622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59900 (local address 127.12.145.62:46551)
0811 06:49:32.071775 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:32.071779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:32.072157 (+ 378us) server_negotiation.cc:407] Connection header received
0811 06:49:32.072389 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:32.072393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:32.072462 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:32.072614 (+ 152us) server_negotiation.cc:226] Negotiated authn=JWT
0811 06:49:32.073102 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:32.073897 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:32.075217 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:32.075654 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:32.075763 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:32.076248 (+ 485us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 06:49:32.097367 (+ 21119us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44883/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 06:49:32.097800 (+ 433us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59900: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44883/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 06:49:32.098250 21856 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59900: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44883/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 06:49:32.098361 21899 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:49:32.071455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:46551 (local address 127.0.0.1:59900)
0811 06:49:32.072049 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:32.072066 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:32.072210 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:32.072637 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:32.072641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:32.072653 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0811 06:49:32.072923 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:32.072932 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:32.074048 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:32.074052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:32.075070 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:32.075082 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:32.075811 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:32.075817 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:32.075963 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:32.076007 (+ 44us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 06:49:32.097640 (+ 21633us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44883/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 06:49:32.097947 (+ 307us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.145.62:46551: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44883/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":299,"threads_started":1}
I20260811 06:49:32.100000 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 21740
I20260811 06:49:32.101156 21841 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:32.194182 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 21740
2026-08-11T06:49:32Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (761 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 06:49:32.255600 12868 mini_oidc.cc:152] Starting JWKS server
I20260811 06:49:32.257488 12868 webserver.cc:460] Webserver started at https://127.0.0.1:39771/ using document root <none> and password file <none>
I20260811 06:49:32.257761 12868 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 06:49:32.258383 12868 webserver.cc:460] Webserver started at http://127.0.0.1:44303/ using document root <none> and password file <none>
2026-08-11T06:49:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:32Z Disabled control of system clock
I20260811 06:49:32.290488 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:42151
--webserver_interface=127.12.145.62
--webserver_port=0
--builtin_ntp_servers=127.12.145.20:43581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:42151
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39771/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 06:49:32.635293 21916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:32.635664 21916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:32.635829 21916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:32.643378 21916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:32.643515 21916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:32.643594 21916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:32.643687 21916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:32.643759 21916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 06:49:32.643859 21916 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 06:49:32.643922 21916 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39771/jwks.json
I20260811 06:49:32.653718 21916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:42151
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:42151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39771/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:32.655341 21916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:32.657608 21916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:32.669941 21933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:32.670090 21929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:32.670102 21925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:32.671154 21916 server_base.cc:1034] running on GCE node
I20260811 06:49:32.671983 21916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:32.673455 21916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:32.674695 21916 hybrid_clock.cc:648] HybridClock initialized: now 1786430972674639 us; error 44 us; skew 500 ppm
I20260811 06:49:32.675061 21916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:49:32.677327 21916 webserver.cc:460] Webserver started at http://127.12.145.62:42093/ using document root <none> and password file <none>
I20260811 06:49:32.678069 21916 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:32.678187 21916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:32.678509 21916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:32.681450 21916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "945d0d0524e4487d9619ec33c1b5e6af"
format_stamp: "Formatted at 2026-08-11 06:49:32 on dist-test-slave-7lbf"
server_key: "41aaa1512ed38b4b86be24927458f942"
server_key_iv: "e44fa540c0fae97d7e95e52abf42a868"
server_key_version: "encryptionkey@0"
I20260811 06:49:32.682375 21916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "945d0d0524e4487d9619ec33c1b5e6af"
format_stamp: "Formatted at 2026-08-11 06:49:32 on dist-test-slave-7lbf"
server_key: "41aaa1512ed38b4b86be24927458f942"
server_key_iv: "e44fa540c0fae97d7e95e52abf42a868"
server_key_version: "encryptionkey@0"
I20260811 06:49:32.687666 21916 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:49:32.691273 21942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:32.692610 21916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:49:32.692790 21916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "945d0d0524e4487d9619ec33c1b5e6af"
format_stamp: "Formatted at 2026-08-11 06:49:32 on dist-test-slave-7lbf"
server_key: "41aaa1512ed38b4b86be24927458f942"
server_key_iv: "e44fa540c0fae97d7e95e52abf42a868"
server_key_version: "encryptionkey@0"
I20260811 06:49:32.693005 21916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:32.730991 21916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:32.731910 21916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:32.732232 21916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:32.749795 21916 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:42151
I20260811 06:49:32.749816 22027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:42151 every 8 connection(s)
I20260811 06:49:32.751200 21916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:32.755025 22028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:32.760792 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 21916
I20260811 06:49:32.761008 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:32.761864 12868 external_mini_cluster.cc:1428] Setting key 6b808b7b04f9a161ac940eb85e72d368
I20260811 06:49:32.766722 22028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af: Bootstrap starting.
I20260811 06:49:32.770018 22028 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:32.771334 22028 log.cc:824] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:32.774770 22028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af: No bootstrap required, opened a new log
I20260811 06:49:32.776530 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:32.764025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36730 (local address 127.12.145.62:42151)
0811 06:49:32.765049 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:32.765060 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:32.765100 (+ 40us) server_negotiation.cc:407] Connection header received
0811 06:49:32.766884 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:32.766912 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:32.767393 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:32.767751 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:32.768377 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:32.769769 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:32.771673 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:32.772446 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:32.772571 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:32.773710 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:32.773721 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:32.773739 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:32.774471 (+ 732us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:32.774570 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:32.774603 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:32.774717 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:32.774923 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 06:49:32.775263 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":332,"threads_started":1}
I20260811 06:49:32.780625 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:49:32.783463 22028 raft_consensus.cc:348] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945d0d0524e4487d9619ec33c1b5e6af" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42151 } }
I20260811 06:49:32.783866 22028 raft_consensus.cc:374] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:32.783974 22028 raft_consensus.cc:729] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 945d0d0524e4487d9619ec33c1b5e6af, State: Initialized, Role: FOLLOWER
I20260811 06:49:32.784507 22028 consensus_queue.cc:260] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945d0d0524e4487d9619ec33c1b5e6af" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42151 } }
I20260811 06:49:32.784726 22028 raft_consensus.cc:388] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:32.784852 22028 raft_consensus.cc:482] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:32.785017 22028 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:32.787724 22028 raft_consensus.cc:504] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945d0d0524e4487d9619ec33c1b5e6af" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42151 } }
I20260811 06:49:32.788213 22028 leader_election.cc:302] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 945d0d0524e4487d9619ec33c1b5e6af; no voters:
I20260811 06:49:32.788928 22028 leader_election.cc:288] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:32.789181 22034 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:32.792016 22028 sys_catalog.cc:564] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:32.797061 22034 raft_consensus.cc:686] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [term 1 LEADER]: Becoming Leader. State: Replica: 945d0d0524e4487d9619ec33c1b5e6af, State: Running, Role: LEADER
I20260811 06:49:32.797564 22034 consensus_queue.cc:237] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945d0d0524e4487d9619ec33c1b5e6af" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42151 } }
I20260811 06:49:32.800392 22035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "945d0d0524e4487d9619ec33c1b5e6af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945d0d0524e4487d9619ec33c1b5e6af" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42151 } } }
I20260811 06:49:32.800494 22037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 945d0d0524e4487d9619ec33c1b5e6af. Latest consensus state: current_term: 1 leader_uuid: "945d0d0524e4487d9619ec33c1b5e6af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945d0d0524e4487d9619ec33c1b5e6af" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42151 } } }
I20260811 06:49:32.800802 22035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:32.800858 22037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af [sys.catalog]: This master's current role is: LEADER
W20260811 06:49:32.805593 22056 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:32.805708 22056 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:32.805837 22057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:32.807458 22057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:32.815398 22057 catalog_manager.cc:1347] Generated new cluster ID: a5989401bda54e46acac9bfe08bd8608
I20260811 06:49:32.815505 22057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:32.824899 22057 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:32.826735 22057 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:32.848253 22057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 945d0d0524e4487d9619ec33c1b5e6af: Generated new TSK 0
I20260811 06:49:32.849421 22057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:49:32.882506 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:32.873580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36732 (local address 127.12.145.62:42151)
0811 06:49:32.873781 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:32.873788 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:32.874128 (+ 340us) server_negotiation.cc:407] Connection header received
0811 06:49:32.874351 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:32.874357 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:32.874447 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:32.874646 (+ 199us) server_negotiation.cc:226] Negotiated authn=JWT
0811 06:49:32.875258 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:32.876410 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:32.877990 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:32.878711 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:32.878841 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:32.879387 (+ 546us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 06:49:32.881818 (+ 2431us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39771/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 06:49:32.882166 (+ 348us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36732: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39771/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 06:49:32.882650 22031 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36732: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39771/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 06:49:32.884308 22082 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:49:32.873412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:42151 (local address 127.0.0.1:36732)
0811 06:49:32.874025 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:32.874044 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:32.874168 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:32.874698 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:32.874702 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:32.874714 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0811 06:49:32.875087 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:32.875097 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:32.876585 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:32.876590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:32.877827 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:32.877842 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:32.878919 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:32.878924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:32.879056 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:32.879093 (+ 37us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 06:49:32.882036 (+ 2943us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39771/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 06:49:32.883819 (+ 1783us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.145.62:42151: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39771/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":491,"mutex_wait_us":1452,"thread_start_us":326,"threads_started":1}
I20260811 06:49:32.885694 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 21916
I20260811 06:49:32.887104 22022 generic_service.cc:196] Checking for leaks (request via RPC)
E20260811 06:49:32.894927 22084 webserver.cc:533] Webserver: sslize failed:
E20260811 06:49:32.895048 22084 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 06:49:32.981463 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 21916
2026-08-11T06:49:33Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (788 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T06:49:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:33Z Disabled control of system clock
I20260811 06:49:33.076392 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:40145
--webserver_interface=127.12.145.62
--webserver_port=0
--builtin_ntp_servers=127.12.145.20:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:40145
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/testchainca.cert with env {}
W20260811 06:49:33.408627 22091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:33.408947 22091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:33.409035 22091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:33.416265 22091 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:33.416374 22091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:33.416411 22091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:33.416464 22091 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:33.416507 22091 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 06:49:33.416567 22091 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 06:49:33.416606 22091 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 06:49:33.426674 22091 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:40145
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:40145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:33.427958 22091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:33.429243 22091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:33.440696 22100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:33.440647 22105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:33.440757 22103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:33.442035 22091 server_base.cc:1034] running on GCE node
I20260811 06:49:33.442813 22091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:33.444197 22091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:33.445402 22091 hybrid_clock.cc:648] HybridClock initialized: now 1786430973445343 us; error 54 us; skew 500 ppm
I20260811 06:49:33.445796 22091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:49:33.447989 22091 webserver.cc:460] Webserver started at http://127.12.145.62:34157/ using document root <none> and password file <none>
I20260811 06:49:33.448705 22091 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:33.448817 22091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:33.449124 22091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:33.452039 22091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "ada616c595cf4bc68c9b9646d1fbc001"
format_stamp: "Formatted at 2026-08-11 06:49:33 on dist-test-slave-7lbf"
server_key: "6ccfc4d668a1200345e950de8f05719b"
server_key_iv: "4d97e9d11c188b0bee248ff8639f4da7"
server_key_version: "encryptionkey@0"
I20260811 06:49:33.452834 22091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "ada616c595cf4bc68c9b9646d1fbc001"
format_stamp: "Formatted at 2026-08-11 06:49:33 on dist-test-slave-7lbf"
server_key: "6ccfc4d668a1200345e950de8f05719b"
server_key_iv: "4d97e9d11c188b0bee248ff8639f4da7"
server_key_version: "encryptionkey@0"
I20260811 06:49:33.457988 22091 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 06:49:33.461364 22115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:33.462698 22091 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:33.462865 22091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "ada616c595cf4bc68c9b9646d1fbc001"
format_stamp: "Formatted at 2026-08-11 06:49:33 on dist-test-slave-7lbf"
server_key: "6ccfc4d668a1200345e950de8f05719b"
server_key_iv: "4d97e9d11c188b0bee248ff8639f4da7"
server_key_version: "encryptionkey@0"
I20260811 06:49:33.463064 22091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:33.481662 22091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:33.482522 22091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:33.482795 22091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:33.500294 22091 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:40145
I20260811 06:49:33.500311 22200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:40145 every 8 connection(s)
I20260811 06:49:33.501773 22091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:33.505681 22201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:33.506999 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 22091
I20260811 06:49:33.507196 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:33.507814 12868 external_mini_cluster.cc:1428] Setting key 46e5eefc428b0a296fc37af4a52f5bb1
I20260811 06:49:33.519429 22201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001: Bootstrap starting.
I20260811 06:49:33.520991 22204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:33.509438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58972 (local address 127.12.145.62:40145)
0811 06:49:33.510434 (+ 996us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:33.510455 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:33.510498 (+ 43us) server_negotiation.cc:407] Connection header received
0811 06:49:33.512126 (+ 1628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:33.512148 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:33.512624 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:33.512965 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:33.513582 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:33.514815 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:33.516617 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:33.517310 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:33.517438 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:33.518674 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:33.518682 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:33.518696 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:49:33.519309 (+ 613us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:33.519387 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:49:33.519409 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:33.519496 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:33.519743 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 06:49:33.520060 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":318,"threads_started":1}
I20260811 06:49:33.522996 22201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:33.524211 22201 log.cc:824] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:33.525252 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:49:33.527171 22201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001: No bootstrap required, opened a new log
I20260811 06:49:33.534695 22201 raft_consensus.cc:348] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada616c595cf4bc68c9b9646d1fbc001" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40145 } }
I20260811 06:49:33.535060 22201 raft_consensus.cc:374] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:33.535156 22201 raft_consensus.cc:729] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ada616c595cf4bc68c9b9646d1fbc001, State: Initialized, Role: FOLLOWER
I20260811 06:49:33.535688 22201 consensus_queue.cc:260] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada616c595cf4bc68c9b9646d1fbc001" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40145 } }
I20260811 06:49:33.535903 22201 raft_consensus.cc:388] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:33.536032 22201 raft_consensus.cc:482] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:33.536196 22201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:33.538506 22201 raft_consensus.cc:504] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada616c595cf4bc68c9b9646d1fbc001" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40145 } }
I20260811 06:49:33.539012 22201 leader_election.cc:302] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ada616c595cf4bc68c9b9646d1fbc001; no voters:
I20260811 06:49:33.539597 22201 leader_election.cc:288] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:33.539790 22208 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:33.540541 22208 raft_consensus.cc:686] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [term 1 LEADER]: Becoming Leader. State: Replica: ada616c595cf4bc68c9b9646d1fbc001, State: Running, Role: LEADER
I20260811 06:49:33.541098 22208 consensus_queue.cc:237] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada616c595cf4bc68c9b9646d1fbc001" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40145 } }
I20260811 06:49:33.541723 22201 sys_catalog.cc:564] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:33.546353 22213 sys_catalog.cc:455] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ada616c595cf4bc68c9b9646d1fbc001. Latest consensus state: current_term: 1 leader_uuid: "ada616c595cf4bc68c9b9646d1fbc001" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada616c595cf4bc68c9b9646d1fbc001" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40145 } } }
I20260811 06:49:33.546763 22213 sys_catalog.cc:458] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:33.547343 22209 sys_catalog.cc:455] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ada616c595cf4bc68c9b9646d1fbc001" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada616c595cf4bc68c9b9646d1fbc001" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40145 } } }
I20260811 06:49:33.547691 22209 sys_catalog.cc:458] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:33.550767 22230 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:33.555353 22230 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:33.563421 22230 catalog_manager.cc:1347] Generated new cluster ID: 8851e3017de942edabd44cf5dfa65a4e
I20260811 06:49:33.563553 22230 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:33.573414 22230 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:33.574676 22230 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:33.585415 22230 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ada616c595cf4bc68c9b9646d1fbc001: Generated new TSK 0
I20260811 06:49:33.586234 22230 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:49:34.458863 22204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:33.598436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58988 (local address 127.12.145.62:40145)
0811 06:49:33.598647 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:33.598655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:33.599155 (+ 500us) server_negotiation.cc:407] Connection header received
0811 06:49:33.599407 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:33.599411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:33.599481 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:33.599622 (+ 141us) server_negotiation.cc:226] Negotiated authn=JWT
0811 06:49:33.600077 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:33.600814 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:33.602225 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:33.602662 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:33.602777 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:33.603278 (+ 501us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 06:49:34.458135 (+854857us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 06:49:34.458560 (+ 425us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58988: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 06:49:34.459007 22204 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58988: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 06:49:34.459141 22250 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:49:33.598271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40145 (local address 127.0.0.1:58988)
0811 06:49:33.599051 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:33.599067 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:33.599213 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:33.599652 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:33.599657 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:33.599669 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0811 06:49:33.599926 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:33.599935 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:33.600965 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:33.600969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:33.602081 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:33.602094 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:33.602844 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:33.602851 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:33.602975 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:33.603010 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 06:49:34.458443 (+855433us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 06:49:34.458745 (+ 302us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.145.62:40145: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":509,"threads_started":1}
I20260811 06:49:34.460423 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 22091
I20260811 06:49:34.461583 22193 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:34.563267 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 22091
2026-08-11T06:49:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1562 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (418 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (419 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:49:35 dist-test-slave-7lbf krb5kdc[22280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:49:35 dist-test-slave-7lbf krb5kdc[22280](info): set up 2 sockets
Aug 11 06:49:35 dist-test-slave-7lbf krb5kdc[22280](info): commencing operation
krb5kdc: starting...
W20260811 06:49:36.638439 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:49:36 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:49:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:49:36.864414 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:46151
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:40279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:46151
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:37.187162 22297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:37.187460 22297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:37.187597 22297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:37.194660 22297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:37.194775 22297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:37.194867 22297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:37.194942 22297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:37.194999 22297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:37.204699 22297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:40279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:46151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:46151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:37.206136 22297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:37.207445 22297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:37.219409 22311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:37.219429 22317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:37.219583 22319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:37.220229 22297 server_base.cc:1034] running on GCE node
I20260811 06:49:37.221061 22297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:37.222595 22297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:37.223821 22297 hybrid_clock.cc:648] HybridClock initialized: now 1786430977223773 us; error 45 us; skew 500 ppm
I20260811 06:49:37.224210 22297 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:37 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430977, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:37.230014 22297 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:49:37.231637 22297 webserver.cc:460] Webserver started at http://127.12.145.62:43379/ using document root <none> and password file <none>
I20260811 06:49:37.232335 22297 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:37.232462 22297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:37.232781 22297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:37.235798 22297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "b43286f072104f4ba4c1be517f5932eb"
format_stamp: "Formatted at 2026-08-11 06:49:37 on dist-test-slave-7lbf"
server_key: "956fc43c1a7cde5e9bc0151f55aa181b"
server_key_iv: "e434a70d6227e44392810bd0802611ed"
server_key_version: "encryptionkey@0"
I20260811 06:49:37.236586 22297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "b43286f072104f4ba4c1be517f5932eb"
format_stamp: "Formatted at 2026-08-11 06:49:37 on dist-test-slave-7lbf"
server_key: "956fc43c1a7cde5e9bc0151f55aa181b"
server_key_iv: "e434a70d6227e44392810bd0802611ed"
server_key_version: "encryptionkey@0"
I20260811 06:49:37.241894 22297 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 06:49:37.245671 22332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:37.247013 22297 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:49:37.247195 22297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "b43286f072104f4ba4c1be517f5932eb"
format_stamp: "Formatted at 2026-08-11 06:49:37 on dist-test-slave-7lbf"
server_key: "956fc43c1a7cde5e9bc0151f55aa181b"
server_key_iv: "e434a70d6227e44392810bd0802611ed"
server_key_version: "encryptionkey@0"
I20260811 06:49:37.247414 22297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:37.299418 22297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:37.303743 22297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:37.304023 22297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:37.322150 22297 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:46151
I20260811 06:49:37.322170 22418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:46151 every 8 connection(s)
I20260811 06:49:37.323527 22297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:37.325598 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 22297
I20260811 06:49:37.325831 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:37.326453 12868 external_mini_cluster.cc:1428] Setting key bf45ee163056f474b1ea3f357f803231
I20260811 06:49:37.327483 22419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 06:49:37 dist-test-slave-7lbf krb5kdc[22280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:37.339253 22419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb: Bootstrap starting.
I20260811 06:49:37.342727 22419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:37.343845 22419 log.cc:824] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:37.346815 22419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb: No bootstrap required, opened a new log
I20260811 06:49:37.347529 22424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:37.328403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49992 (local address 127.12.145.62:46151)
0811 06:49:37.329129 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:37.329140 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:37.329180 (+ 40us) server_negotiation.cc:407] Connection header received
0811 06:49:37.330793 (+ 1613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:37.330815 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:37.331202 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:37.331574 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:37.332988 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:37.334378 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:37.335590 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:37.336268 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:37.336457 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:37.340443 (+ 3986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:37.340451 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:37.340464 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:37.340500 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:37.343488 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:37.344274 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:37.344281 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:37.344287 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:37.344451 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:37.344835 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:37.344838 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:37.344840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:37.345409 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:37.345688 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:37.346153 (+ 465us) server_negotiation.cc:299] Negotiation successful
0811 06:49:37.346526 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":300,"threads_started":1}
I20260811 06:49:37.355016 22419 raft_consensus.cc:348] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43286f072104f4ba4c1be517f5932eb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46151 } }
I20260811 06:49:37.355363 22419 raft_consensus.cc:374] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:37.355460 22419 raft_consensus.cc:729] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43286f072104f4ba4c1be517f5932eb, State: Initialized, Role: FOLLOWER
I20260811 06:49:37.355996 22419 consensus_queue.cc:260] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43286f072104f4ba4c1be517f5932eb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46151 } }
I20260811 06:49:37.356204 22419 raft_consensus.cc:388] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:37.356334 22419 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:37.356482 22419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:37.358634 22419 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43286f072104f4ba4c1be517f5932eb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46151 } }
I20260811 06:49:37.359109 22419 leader_election.cc:302] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b43286f072104f4ba4c1be517f5932eb; no voters:
I20260811 06:49:37.359629 22419 leader_election.cc:288] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:37.359759 22428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:37.360838 22428 raft_consensus.cc:686] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [term 1 LEADER]: Becoming Leader. State: Replica: b43286f072104f4ba4c1be517f5932eb, State: Running, Role: LEADER
I20260811 06:49:37.361294 22428 consensus_queue.cc:237] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43286f072104f4ba4c1be517f5932eb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46151 } }
I20260811 06:49:37.361732 22419 sys_catalog.cc:564] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:37.363838 22429 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b43286f072104f4ba4c1be517f5932eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43286f072104f4ba4c1be517f5932eb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46151 } } }
I20260811 06:49:37.363803 22431 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b43286f072104f4ba4c1be517f5932eb. Latest consensus state: current_term: 1 leader_uuid: "b43286f072104f4ba4c1be517f5932eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43286f072104f4ba4c1be517f5932eb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46151 } } }
I20260811 06:49:37.364259 22429 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:37.364439 22431 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:37.365178 22441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:37.371263 22441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:37.381626 22441 catalog_manager.cc:1347] Generated new cluster ID: 333129f096a14b5eb92a7499147fcfbd
I20260811 06:49:37.381742 22441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:37.395224 22441 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:37.396536 22441 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:37.407213 22441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b43286f072104f4ba4c1be517f5932eb: Generated new TSK 0
I20260811 06:49:37.408079 22441 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:49:37.472342 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46151
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:40279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:37.798237 22463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:37.798516 22463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:37.798617 22463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:37.805708 22463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:37.805809 22463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:37.805923 22463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:49:37.815563 22463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:40279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46151
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:37.816721 22463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:37.817989 22463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:37.830179 22471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:37.830279 22472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:37.830852 22475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:37.831326 22463 server_base.cc:1034] running on GCE node
I20260811 06:49:37.831899 22463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:37.832800 22463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:37.834008 22463 hybrid_clock.cc:648] HybridClock initialized: now 1786430977833946 us; error 47 us; skew 500 ppm
I20260811 06:49:37.834307 22463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:37 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430977, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:37.837313 22463 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:49:37.838689 22463 webserver.cc:460] Webserver started at http://127.12.145.1:44093/ using document root <none> and password file <none>
I20260811 06:49:37.839466 22463 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:37.839593 22463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:37.839887 22463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:37.842779 22463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "3eb6ae4475d1474fa38b94d8f3ef4e97"
format_stamp: "Formatted at 2026-08-11 06:49:37 on dist-test-slave-7lbf"
server_key: "b225cb341379ff213356d8df6960abe2"
server_key_iv: "1856f7c2669830a179ffac8977405f4d"
server_key_version: "encryptionkey@0"
I20260811 06:49:37.843541 22463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "3eb6ae4475d1474fa38b94d8f3ef4e97"
format_stamp: "Formatted at 2026-08-11 06:49:37 on dist-test-slave-7lbf"
server_key: "b225cb341379ff213356d8df6960abe2"
server_key_iv: "1856f7c2669830a179ffac8977405f4d"
server_key_version: "encryptionkey@0"
I20260811 06:49:37.848662 22463 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 06:49:37.852226 22489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:37.853498 22463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:49:37.853688 22463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "3eb6ae4475d1474fa38b94d8f3ef4e97"
format_stamp: "Formatted at 2026-08-11 06:49:37 on dist-test-slave-7lbf"
server_key: "b225cb341379ff213356d8df6960abe2"
server_key_iv: "1856f7c2669830a179ffac8977405f4d"
server_key_version: "encryptionkey@0"
I20260811 06:49:37.853881 22463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:37.878124 22463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:37.882058 22463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:37.882331 22463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:37.883288 22463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:37.884588 22463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:37.884660 22463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:37.884756 22463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:37.884811 22463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:37.912981 22463 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:43745
I20260811 06:49:37.913046 22680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:43745 every 8 connection(s)
I20260811 06:49:37.914258 22463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:49:37.924624 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 22463
I20260811 06:49:37.924820 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:49:37.925426 12868 external_mini_cluster.cc:1428] Setting key 980fe11e3953d50b197cf2f5434a81c8
Aug 11 06:49:37 dist-test-slave-7lbf krb5kdc[22280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430977, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:37.932871 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:37.916686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:50675 (local address 127.12.145.62:46151)
0811 06:49:37.917114 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:37.917119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:37.917976 (+ 857us) server_negotiation.cc:407] Connection header received
0811 06:49:37.919750 (+ 1774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:37.919756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:37.919837 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:37.919937 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:37.921395 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:37.922125 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:37.923632 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:37.924028 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:37.924143 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:37.927570 (+ 3427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:37.927575 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:37.927579 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:37.927610 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:37.930055 (+ 2445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:37.930723 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:37.930729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:37.930732 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:37.930848 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:37.931240 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:37.931245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:37.931249 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:37.931501 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:37.931631 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:37.932314 (+ 683us) server_negotiation.cc:299] Negotiation successful
0811 06:49:37.932531 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":227,"threads_started":1}
I20260811 06:49:37.933765 22686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:37.917098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:46151 (local address 127.12.145.1:50675)
0811 06:49:37.917822 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:37.917866 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:37.919486 (+ 1620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:37.920177 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:37.920185 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:37.920665 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:37.921221 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:37.921239 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:37.922276 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:37.922280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:37.923486 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:37.923499 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:37.924246 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:37.924253 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:37.924472 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:37.925084 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:37.925106 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:37.927375 (+ 2269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:37.930182 (+ 2807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:37.930191 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:37.930205 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:37.930612 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:37.930952 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:37.930957 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:37.930961 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:37.931135 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:37.931630 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:37.931638 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:37.931944 (+ 306us) client_negotiation.cc:769] Sending connection context
0811 06:49:37.932173 (+ 229us) client_negotiation.cc:240] Negotiation successful
0811 06:49:37.932643 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":270,"threads_started":1}
I20260811 06:49:37.935276 22681 heartbeater.cc:347] Connected to a master server at 127.12.145.62:46151
I20260811 06:49:37.935554 22681 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:37.936220 22681 heartbeater.cc:511] Master 127.12.145.62:46151 requested a full tablet report, sending...
I20260811 06:49:37.938410 22362 ts_manager.cc:194] Registered new tserver with Master: 3eb6ae4475d1474fa38b94d8f3ef4e97 (127.12.145.1:43745)
I20260811 06:49:37.940336 22362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:50675
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:49:37.974473 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46151
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:40279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:38.292701 22690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:38.292987 22690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:38.293112 22690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:38.300673 22690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:38.300776 22690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:38.300940 22690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:49:38.310822 22690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:40279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46151
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:38.312068 22690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:38.313377 22690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:38.327185 22699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:38.327739 22698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:38.327859 22701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:38.328452 22690 server_base.cc:1034] running on GCE node
I20260811 06:49:38.329154 22690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:38.330310 22690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:38.331544 22690 hybrid_clock.cc:648] HybridClock initialized: now 1786430978331484 us; error 50 us; skew 500 ppm
I20260811 06:49:38.331897 22690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:38.335731 22690 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:49:38.337435 22690 webserver.cc:460] Webserver started at http://127.12.145.2:44857/ using document root <none> and password file <none>
I20260811 06:49:38.338323 22690 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:38.338454 22690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:38.338769 22690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:38.342561 22690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "0f2cb164da714507b8718fc1ed61dff8"
format_stamp: "Formatted at 2026-08-11 06:49:38 on dist-test-slave-7lbf"
server_key: "8f7594b4aa38e8632c17f133f0216db3"
server_key_iv: "2a75c4580e4b7fc1aa788fb9d680e4c4"
server_key_version: "encryptionkey@0"
I20260811 06:49:38.343302 22690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "0f2cb164da714507b8718fc1ed61dff8"
format_stamp: "Formatted at 2026-08-11 06:49:38 on dist-test-slave-7lbf"
server_key: "8f7594b4aa38e8632c17f133f0216db3"
server_key_iv: "2a75c4580e4b7fc1aa788fb9d680e4c4"
server_key_version: "encryptionkey@0"
I20260811 06:49:38.348461 22690 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 06:49:38.352067 22708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:38.353446 22690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:49:38.353662 22690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "0f2cb164da714507b8718fc1ed61dff8"
format_stamp: "Formatted at 2026-08-11 06:49:38 on dist-test-slave-7lbf"
server_key: "8f7594b4aa38e8632c17f133f0216db3"
server_key_iv: "2a75c4580e4b7fc1aa788fb9d680e4c4"
server_key_version: "encryptionkey@0"
I20260811 06:49:38.353840 22690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:38.371605 22690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:38.375787 22690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:38.376065 22690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:38.377056 22690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:38.378456 22690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:38.378532 22690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:38.378646 22690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:38.378698 22690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:38.409312 22690 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:43807
I20260811 06:49:38.409391 22884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:43807 every 8 connection(s)
I20260811 06:49:38.410650 22690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:49:38.414345 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 22690
I20260811 06:49:38.414551 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:49:38.415048 12868 external_mini_cluster.cc:1428] Setting key a55fbe9e8012c249063ddb19da0b4799
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:38.431082 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:38.413107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:49327 (local address 127.12.145.62:46151)
0811 06:49:38.413311 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:38.413326 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:38.414563 (+ 1237us) server_negotiation.cc:407] Connection header received
0811 06:49:38.416682 (+ 2119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:38.416687 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:38.416750 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:38.416845 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:38.418458 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.419477 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.420969 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.421536 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.421657 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:38.425036 (+ 3379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:38.425043 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:38.425047 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:38.425085 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:38.428039 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:38.428866 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:38.428870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:38.428872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:38.428993 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:38.429437 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:38.429440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:38.429442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:38.429720 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:38.429833 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:38.430664 (+ 831us) server_negotiation.cc:299] Negotiation successful
0811 06:49:38.430840 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 06:49:38.432530 22890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:38.413673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:46151 (local address 127.12.145.2:49327)
0811 06:49:38.414394 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:38.414444 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:38.416366 (+ 1922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:38.417120 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:38.417132 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:38.417724 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:38.418284 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:38.418301 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.419602 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.419605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:38.420825 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:38.420837 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.421731 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.421736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:38.421934 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:38.422567 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:38.422595 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:38.424813 (+ 2218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:38.428180 (+ 3367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:38.428189 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:38.428207 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:38.428761 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:38.429087 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:38.429092 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:38.429095 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:38.429341 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:38.429842 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:38.429850 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:38.430273 (+ 423us) client_negotiation.cc:769] Sending connection context
0811 06:49:38.430599 (+ 326us) client_negotiation.cc:240] Negotiation successful
0811 06:49:38.431130 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":297,"threads_started":1}
I20260811 06:49:38.434259 22886 heartbeater.cc:347] Connected to a master server at 127.12.145.62:46151
I20260811 06:49:38.434628 22886 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:38.435462 22886 heartbeater.cc:511] Master 127.12.145.62:46151 requested a full tablet report, sending...
I20260811 06:49:38.437307 22362 ts_manager.cc:194] Registered new tserver with Master: 0f2cb164da714507b8718fc1ed61dff8 (127.12.145.2:43807)
I20260811 06:49:38.438231 22362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:49327
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:49:38.468598 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46151
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:40279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:38.786851 22894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:38.787235 22894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:38.787370 22894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:38.795656 22894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:38.795778 22894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:38.795955 22894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:49:38.805860 22894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:40279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46151
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:38.807214 22894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:38.808514 22894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:38.821413 22901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:38.821449 22906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:38.821362 22902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:38.822440 22894 server_base.cc:1034] running on GCE node
I20260811 06:49:38.823082 22894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:38.824003 22894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:38.825206 22894 hybrid_clock.cc:648] HybridClock initialized: now 1786430978825155 us; error 47 us; skew 500 ppm
I20260811 06:49:38.825560 22894 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:38.828645 22894 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:49:38.830133 22894 webserver.cc:460] Webserver started at http://127.12.145.3:43693/ using document root <none> and password file <none>
I20260811 06:49:38.830834 22894 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:38.830973 22894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:38.831245 22894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:38.834194 22894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "0528bad5cf7c42089baf0ebd74404079"
format_stamp: "Formatted at 2026-08-11 06:49:38 on dist-test-slave-7lbf"
server_key: "40e8203b6f462a2270ec322679da6b66"
server_key_iv: "aec125e66c03e22da95fd3b83cd2acd9"
server_key_version: "encryptionkey@0"
I20260811 06:49:38.834936 22894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "0528bad5cf7c42089baf0ebd74404079"
format_stamp: "Formatted at 2026-08-11 06:49:38 on dist-test-slave-7lbf"
server_key: "40e8203b6f462a2270ec322679da6b66"
server_key_iv: "aec125e66c03e22da95fd3b83cd2acd9"
server_key_version: "encryptionkey@0"
I20260811 06:49:38.840090 22894 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:49:38.843462 22916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:38.844703 22894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:49:38.844839 22894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "0528bad5cf7c42089baf0ebd74404079"
format_stamp: "Formatted at 2026-08-11 06:49:38 on dist-test-slave-7lbf"
server_key: "40e8203b6f462a2270ec322679da6b66"
server_key_iv: "aec125e66c03e22da95fd3b83cd2acd9"
server_key_version: "encryptionkey@0"
I20260811 06:49:38.845019 22894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:38.861222 22894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:38.865171 22894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:38.865410 22894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:38.866338 22894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:38.867640 22894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:38.867710 22894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:38.867802 22894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:38.867843 22894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:38.897997 22894 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:45089
I20260811 06:49:38.898064 23109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:45089 every 8 connection(s)
I20260811 06:49:38.899289 22894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:49:38.908159 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 22894
I20260811 06:49:38.908370 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:49:38.908893 12868 external_mini_cluster.cc:1428] Setting key 6ac20a11456c00085ac6180c53f0414c
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:49:38.918941 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:38.901721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:41625 (local address 127.12.145.62:46151)
0811 06:49:38.901928 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:38.901934 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:38.903086 (+ 1152us) server_negotiation.cc:407] Connection header received
0811 06:49:38.904786 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:38.904791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:38.904861 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:38.904958 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:38.906359 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.907109 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.909016 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.909394 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.909506 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:38.913119 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:38.913125 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:38.913129 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:38.913168 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:38.916229 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:38.916882 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:38.916887 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:38.916891 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:38.917052 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:38.917453 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:38.917458 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:38.917461 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:38.917829 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:38.917981 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:38.918552 (+ 571us) server_negotiation.cc:299] Negotiation successful
0811 06:49:38.918704 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 06:49:38.919780 23114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:38.902233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:46151 (local address 127.12.145.3:41625)
0811 06:49:38.902932 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:38.902972 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:38.904551 (+ 1579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:38.905141 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:38.905148 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:38.905696 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:38.906223 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:38.906239 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.907235 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.907238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:38.908873 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:38.908890 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.909626 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.909634 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:38.909930 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:38.910554 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:38.910577 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:38.912923 (+ 2346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:38.916356 (+ 3433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:38.916362 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:38.916372 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:38.916770 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:38.917146 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:38.917149 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:38.917151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:38.917334 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:38.917940 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:38.917946 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:38.918225 (+ 279us) client_negotiation.cc:769] Sending connection context
0811 06:49:38.918436 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 06:49:38.918783 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":273,"threads_started":1}
I20260811 06:49:38.921007 23110 heartbeater.cc:347] Connected to a master server at 127.12.145.62:46151
I20260811 06:49:38.921269 23110 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:38.921988 23110 heartbeater.cc:511] Master 127.12.145.62:46151 requested a full tablet report, sending...
I20260811 06:49:38.923427 22362 ts_manager.cc:194] Registered new tserver with Master: 0528bad5cf7c42089baf0ebd74404079 (127.12.145.3:45089)
I20260811 06:49:38.924144 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:49:38.924386 22362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:41625
I20260811 06:49:38.943343 22681 heartbeater.cc:503] Master 127.12.145.62:46151 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/test-admin.keytab.
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:38.954393 12868 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 06:49:38.959515 23124 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:49:38.956897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34576 (local address 127.12.145.1:43745)
0811 06:49:38.957662 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:38.957670 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:38.957698 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:49:38.957766 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:38.957773 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:38.958010 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:38.958180 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:38.959122 (+ 942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34576: BlockingRecv error: recv got EOF from 127.0.0.1:34576 (error 108)
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":381,"threads_started":1}
W20260811 06:49:38.959689 12868 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5cc' of type FILE
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:38.961364 12868 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:38.962762 12868 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:49:38.977484 23124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:38.964168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34580 (local address 127.12.145.1:43745)
0811 06:49:38.964330 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:38.964337 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:38.964607 (+ 270us) server_negotiation.cc:407] Connection header received
0811 06:49:38.964762 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:38.964766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:38.964821 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:38.964899 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:38.965844 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.966772 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.967966 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.968516 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.968628 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:38.972000 (+ 3372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:38.972010 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:38.972024 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:38.972060 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:38.974783 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:38.975516 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:38.975523 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:38.975525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:38.975651 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:38.975992 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:38.975997 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:38.975998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:38.976348 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:38.976627 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:38.976942 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 06:49:38.977195 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 06:49:38.982838 23124 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:49:38.981337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34584 (local address 127.12.145.1:43745)
0811 06:49:38.981561 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:38.981566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:38.981713 (+ 147us) server_negotiation.cc:407] Connection header received
0811 06:49:38.981831 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:38.981835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:38.981889 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:38.981962 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:38.982556 (+ 594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34584: BlockingRecv error: recv got EOF from 127.0.0.1:34584 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 06:49:38.982925 12868 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5cc' of type FILE
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:38.984318 12868 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:38.985546 12868 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:49:38.997928 23124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:38.986663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34592 (local address 127.12.145.1:43745)
0811 06:49:38.986785 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:38.986789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:38.987143 (+ 354us) server_negotiation.cc:407] Connection header received
0811 06:49:38.987242 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:38.987246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:38.987295 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:38.987366 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:38.988161 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.988830 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.990011 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:38.990424 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:38.990523 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:38.993666 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:38.993671 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:38.993674 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:38.993712 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:38.995943 (+ 2231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:38.996486 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:38.996489 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:38.996492 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:38.996597 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:38.996878 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:38.996881 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:38.996883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:38.997120 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:38.997308 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:38.997466 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 06:49:38.997644 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 06:49:39.001746 23124 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:49:39.000167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34606 (local address 127.12.145.1:43745)
0811 06:49:39.000329 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:39.000335 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:39.000593 (+ 258us) server_negotiation.cc:407] Connection header received
0811 06:49:39.000722 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:39.000727 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:39.000798 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:39.000874 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:39.001507 (+ 633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34606: BlockingRecv error: recv got EOF from 127.0.0.1:34606 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 06:49:39.002244 12868 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786430925511755-12868-0/krb5kdc/krb5cc)
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:39.003589 12868 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 06:49:38 dist-test-slave-7lbf krb5kdc[22280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:39.004736 12868 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 06:49:39 dist-test-slave-7lbf krb5kdc[22280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:49:39.018126 23124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:39.005928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34608 (local address 127.12.145.1:43745)
0811 06:49:39.006100 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:39.006105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:39.006365 (+ 260us) server_negotiation.cc:407] Connection header received
0811 06:49:39.006503 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:39.006508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:39.006565 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:39.006637 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:39.007513 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:39.008194 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:39.009374 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:39.009842 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:39.009947 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:39.013104 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:39.013108 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:39.013111 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:39.013140 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:39.015563 (+ 2423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:39.016305 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:39.016310 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:39.016314 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:39.016461 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:39.016791 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:39.016796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:39.016799 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:39.017078 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:39.017366 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:39.017635 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 06:49:39.017833 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 06:49:39.019613 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 22463
I20260811 06:49:39.030202 23124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:39.020252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34622 (local address 127.12.145.1:43745)
0811 06:49:39.020388 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:39.020392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:39.020781 (+ 389us) server_negotiation.cc:407] Connection header received
0811 06:49:39.020906 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:39.020909 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:39.020964 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:39.021033 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:39.021967 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:39.022595 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:39.023741 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:39.024121 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:39.024209 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:39.025998 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:39.026003 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:39.026006 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:39.026033 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:39.028285 (+ 2252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:39.028800 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:39.028803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:39.028805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:39.028924 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:39.029181 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:39.029184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:39.029186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:39.029395 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:39.029618 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:39.029813 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 06:49:39.029957 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 06:49:39.030766 22674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:39.111541 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 22463
I20260811 06:49:39.134100 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 22690
Aug 11 06:49:39 dist-test-slave-7lbf krb5kdc[22280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:49:39.149091 23148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:39.135066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49792 (local address 127.12.145.2:43807)
0811 06:49:39.135643 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:39.135651 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:39.135679 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:49:39.135747 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:39.135754 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:39.135969 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:39.136105 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:39.137118 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:39.138273 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:39.139528 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:39.140086 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:39.140179 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:39.143842 (+ 3663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:39.143853 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:39.143868 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:39.143906 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:39.146671 (+ 2765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:39.147263 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:39.147269 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:39.147272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:39.147398 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:39.147701 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:39.147705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:39.147707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:39.148055 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:39.148292 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:39.148546 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 06:49:39.148789 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":284,"threads_started":1}
I20260811 06:49:39.150399 22878 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:39.231611 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 22690
I20260811 06:49:39.252022 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 22894
Aug 11 06:49:39 dist-test-slave-7lbf krb5kdc[22280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:49:39.266636 23154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:39.252872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44032 (local address 127.12.145.3:45089)
0811 06:49:39.253508 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:39.253542 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:39.253576 (+ 34us) server_negotiation.cc:407] Connection header received
0811 06:49:39.253643 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:39.253649 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:39.253862 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:39.253998 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:39.254924 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:39.255940 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:39.257101 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:39.257837 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:39.257942 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:39.261574 (+ 3632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:39.261586 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:39.261601 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:39.261633 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:39.264242 (+ 2609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:39.264836 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:39.264842 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:39.264845 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:39.264961 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:39.265258 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:39.265261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:39.265262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:39.265648 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:39.265893 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:39.266089 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 06:49:39.266330 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":320,"threads_started":1}
I20260811 06:49:39.267953 23104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:39.349797 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 22894
I20260811 06:49:39.369941 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 22297
I20260811 06:49:39.371088 22411 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:39.472867 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 22297
2026-08-11T06:49:39Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4075 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:49:39 dist-test-slave-7lbf krb5kdc[23163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:49:39 dist-test-slave-7lbf krb5kdc[23163](info): set up 2 sockets
Aug 11 06:49:39 dist-test-slave-7lbf krb5kdc[23163](info): commencing operation
krb5kdc: starting...
W20260811 06:49:40.692845 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.002s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:49:40 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:49:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:49:40Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.62.keytab.
Entry for principal oryx/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.62.keytab.
I20260811 06:49:40.930518 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:38107
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.62.keytab
--principal=oryx/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:38107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:41.252342 23185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:41.252651 23185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:41.252795 23185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:41.259927 23185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:41.260053 23185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:41.260133 23185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:41.260208 23185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:41.260270 23185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:41.270016 23185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:38107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.62.keytab
--principal=oryx/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:38107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:41.271353 23185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:41.272634 23185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:41.283828 23191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:41.283799 23195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:41.284134 23192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:41.285383 23185 server_base.cc:1034] running on GCE node
I20260811 06:49:41.286142 23185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:41.287484 23185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:41.288694 23185 hybrid_clock.cc:648] HybridClock initialized: now 1786430981288639 us; error 38 us; skew 500 ppm
I20260811 06:49:41.289021 23185 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:41 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430981, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:41.292060 23185 init.cc:377] Logged in from keytab as oryx/127.12.145.62@KRBTEST.COM (short username oryx)
I20260811 06:49:41.293444 23185 webserver.cc:460] Webserver started at http://127.12.145.62:44609/ using document root <none> and password file <none>
I20260811 06:49:41.294149 23185 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:41.294251 23185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:41.294509 23185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:41.297456 23185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "9648bd90acc94b9eb272c8cd354f5276"
format_stamp: "Formatted at 2026-08-11 06:49:41 on dist-test-slave-7lbf"
server_key: "a235a8b54826ac1c139818c975d0a087"
server_key_iv: "31ac2cc155bfab746601220cde087167"
server_key_version: "encryptionkey@0"
I20260811 06:49:41.298266 23185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "9648bd90acc94b9eb272c8cd354f5276"
format_stamp: "Formatted at 2026-08-11 06:49:41 on dist-test-slave-7lbf"
server_key: "a235a8b54826ac1c139818c975d0a087"
server_key_iv: "31ac2cc155bfab746601220cde087167"
server_key_version: "encryptionkey@0"
I20260811 06:49:41.303531 23185 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:49:41.306878 23208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:41.308152 23185 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 06:49:41.308296 23185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "9648bd90acc94b9eb272c8cd354f5276"
format_stamp: "Formatted at 2026-08-11 06:49:41 on dist-test-slave-7lbf"
server_key: "a235a8b54826ac1c139818c975d0a087"
server_key_iv: "31ac2cc155bfab746601220cde087167"
server_key_version: "encryptionkey@0"
I20260811 06:49:41.308504 23185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:41.339382 23185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:41.343242 23185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:41.343488 23185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:41.360562 23185 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:38107
I20260811 06:49:41.360597 23301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:38107 every 8 connection(s)
I20260811 06:49:41.361989 23185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:49:41.365701 23302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:41.369674 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 23185
I20260811 06:49:41.369889 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:49:41.370527 12868 external_mini_cluster.cc:1428] Setting key 881f829f620c863639b232e35ffa8aad
I20260811 06:49:41.377848 23302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276: Bootstrap starting.
I20260811 06:49:41.381659 23302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:41.383049 23302 log.cc:824] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276: Log is configured to *not* fsync() on all Append() calls
Aug 11 06:49:41 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:49:41.386098 23302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276: No bootstrap required, opened a new log
I20260811 06:49:41.395653 23305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:41.372512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35772 (local address 127.12.145.62:38107)
0811 06:49:41.373339 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:41.373354 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:41.373405 (+ 51us) server_negotiation.cc:407] Connection header received
0811 06:49:41.376043 (+ 2638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:41.376073 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:41.376557 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:41.377001 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:41.378358 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:41.380368 (+ 2010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:41.381593 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:41.382621 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:41.382818 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:41.386921 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:41.386932 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:41.386950 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:41.387007 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:41.391015 (+ 4008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:41.391730 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:41.391738 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:41.391747 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:41.391956 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:41.392397 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:41.392402 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:41.392406 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:41.393134 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:41.393448 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:41.393750 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 06:49:41.394220 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":350,"threads_started":1}
I20260811 06:49:41.396438 23302 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } }
I20260811 06:49:41.396785 23302 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:41.396889 23302 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9648bd90acc94b9eb272c8cd354f5276, State: Initialized, Role: FOLLOWER
I20260811 06:49:41.397435 23302 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } }
I20260811 06:49:41.397742 23302 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:49:41.397876 23302 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:49:41.398046 23302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:41.400295 23302 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } }
I20260811 06:49:41.400770 23302 leader_election.cc:302] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9648bd90acc94b9eb272c8cd354f5276; no voters:
I20260811 06:49:41.401345 23302 leader_election.cc:288] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:49:41.401499 23307 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:41.402215 23307 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 1 LEADER]: Becoming Leader. State: Replica: 9648bd90acc94b9eb272c8cd354f5276, State: Running, Role: LEADER
I20260811 06:49:41.402702 23307 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } }
I20260811 06:49:41.403415 23302 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:41.405462 23308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } }
I20260811 06:49:41.405992 23308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:41.406162 23309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9648bd90acc94b9eb272c8cd354f5276. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } }
I20260811 06:49:41.406395 23309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:41.408201 23323 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:49:41.413304 23323 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:49:41.422711 23323 catalog_manager.cc:1347] Generated new cluster ID: 3ded78ee6ea14827a36d02142afebf92
I20260811 06:49:41.422824 23323 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:49:41.441192 23323 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:49:41.442519 23323 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:49:41.451258 23323 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276: Generated new TSK 0
I20260811 06:49:41.452127 23323 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab.
Entry for principal oryx/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab.
I20260811 06:49:41.515502 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:38107
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab
--principal=oryx/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:41.843633 23347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:41.843906 23347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:41.844039 23347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:41.851330 23347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:41.851445 23347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:41.851614 23347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:49:41.861207 23347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab
--principal=oryx/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:38107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:41.862493 23347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:41.863724 23347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:41.876255 23357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:41.876330 23354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:41.876232 23355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:41.877254 23347 server_base.cc:1034] running on GCE node
I20260811 06:49:41.877848 23347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:41.878769 23347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:41.879969 23347 hybrid_clock.cc:648] HybridClock initialized: now 1786430981879918 us; error 43 us; skew 500 ppm
I20260811 06:49:41.880260 23347 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:41 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430981, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:41.883219 23347 init.cc:377] Logged in from keytab as oryx/127.12.145.1@KRBTEST.COM (short username oryx)
I20260811 06:49:41.884568 23347 webserver.cc:460] Webserver started at http://127.12.145.1:39695/ using document root <none> and password file <none>
I20260811 06:49:41.885234 23347 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:41.885342 23347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:41.885639 23347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:41.888402 23347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "7661e41354ed4534afc935a0bf9c6249"
format_stamp: "Formatted at 2026-08-11 06:49:41 on dist-test-slave-7lbf"
server_key: "b4e4ea9f5c34770dbadf9e2ad656b1b9"
server_key_iv: "eeb5deb5a9d70f852835ac5eaf093072"
server_key_version: "encryptionkey@0"
I20260811 06:49:41.889112 23347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "7661e41354ed4534afc935a0bf9c6249"
format_stamp: "Formatted at 2026-08-11 06:49:41 on dist-test-slave-7lbf"
server_key: "b4e4ea9f5c34770dbadf9e2ad656b1b9"
server_key_iv: "eeb5deb5a9d70f852835ac5eaf093072"
server_key_version: "encryptionkey@0"
I20260811 06:49:41.893961 23347 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 06:49:41.897213 23369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:41.898466 23347 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:41.898608 23347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "7661e41354ed4534afc935a0bf9c6249"
format_stamp: "Formatted at 2026-08-11 06:49:41 on dist-test-slave-7lbf"
server_key: "b4e4ea9f5c34770dbadf9e2ad656b1b9"
server_key_iv: "eeb5deb5a9d70f852835ac5eaf093072"
server_key_version: "encryptionkey@0"
I20260811 06:49:41.898792 23347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:41.915812 23347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:41.919831 23347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:41.920122 23347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:41.921056 23347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:41.922528 23347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:41.922618 23347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:41.922752 23347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:41.922820 23347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:41.955441 23347 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:37049
I20260811 06:49:41.955473 23557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:37049 every 8 connection(s)
I20260811 06:49:41.956838 23347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:49:41.958880 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 23347
I20260811 06:49:41.959108 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:49:41.959904 12868 external_mini_cluster.cc:1428] Setting key 9ecec0b5761e5d2790f5b400fc7c9b93
Aug 11 06:49:41 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430981, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:49:41.976325 23561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:41.959313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:36315 (local address 127.12.145.62:38107)
0811 06:49:41.959847 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:41.959854 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:41.960843 (+ 989us) server_negotiation.cc:407] Connection header received
0811 06:49:41.962737 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:41.962743 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:41.962842 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:41.962964 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:41.964384 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:41.965382 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:41.966946 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:41.967518 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:41.967664 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:41.970876 (+ 3212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:41.970881 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:41.970884 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:41.970916 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:41.973296 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:41.974051 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:41.974056 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:41.974058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:41.974180 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:41.974609 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:41.974612 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:41.974614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:41.974881 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:41.975026 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:41.975723 (+ 697us) server_negotiation.cc:299] Negotiation successful
0811 06:49:41.975952 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":247,"threads_started":1}
I20260811 06:49:41.977298 23564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:41.959878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:36315)
0811 06:49:41.960686 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:41.960733 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:41.962449 (+ 1716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:41.963147 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:41.963154 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:41.963658 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:41.964200 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:41.964218 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:41.965564 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:41.965569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:41.966785 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:41.966797 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:41.967718 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:41.967722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:41.967920 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:41.968529 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:41.968557 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:41.970665 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:41.973432 (+ 2767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:41.973441 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:41.973457 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:41.973919 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:41.974285 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:41.974290 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:41.974294 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:41.974493 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:41.975008 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:41.975017 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:41.975345 (+ 328us) client_negotiation.cc:769] Sending connection context
0811 06:49:41.975588 (+ 243us) client_negotiation.cc:240] Negotiation successful
0811 06:49:41.976106 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":317,"threads_started":1}
I20260811 06:49:41.978879 23559 heartbeater.cc:347] Connected to a master server at 127.12.145.62:38107
I20260811 06:49:41.979245 23559 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:41.980273 23559 heartbeater.cc:511] Master 127.12.145.62:38107 requested a full tablet report, sending...
I20260811 06:49:41.982605 23241 ts_manager.cc:194] Registered new tserver with Master: 7661e41354ed4534afc935a0bf9c6249 (127.12.145.1:37049)
WARNING: no policy specified for oryx/127.12.145.2@KRBTEST.COM; defaulting to no policy
I20260811 06:49:41.984083 23241 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:36315
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab.
Entry for principal oryx/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab.
I20260811 06:49:42.012475 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:38107
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab
--principal=oryx/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:42.333405 23567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:42.333719 23567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:42.333866 23567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:42.341814 23567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:42.341939 23567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:42.342103 23567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:49:42.351822 23567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab
--principal=oryx/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:38107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:42.353091 23567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:42.354461 23567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:42.369022 23580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:42.369050 23585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:42.369858 23567 server_base.cc:1034] running on GCE node
W20260811 06:49:42.370056 23577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:42.370738 23567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:42.371667 23567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:42.372891 23567 hybrid_clock.cc:648] HybridClock initialized: now 1786430982372793 us; error 60 us; skew 500 ppm
I20260811 06:49:42.373183 23567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:42 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430982, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:42.378582 23567 init.cc:377] Logged in from keytab as oryx/127.12.145.2@KRBTEST.COM (short username oryx)
I20260811 06:49:42.379999 23567 webserver.cc:460] Webserver started at http://127.12.145.2:40875/ using document root <none> and password file <none>
I20260811 06:49:42.380693 23567 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:42.380800 23567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:42.381055 23567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:42.383988 23567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92"
format_stamp: "Formatted at 2026-08-11 06:49:42 on dist-test-slave-7lbf"
server_key: "aa74b0236dd876ecd4d79a38219d16f6"
server_key_iv: "8e39942ecac51a196d346655ecd7e32c"
server_key_version: "encryptionkey@0"
I20260811 06:49:42.384722 23567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92"
format_stamp: "Formatted at 2026-08-11 06:49:42 on dist-test-slave-7lbf"
server_key: "aa74b0236dd876ecd4d79a38219d16f6"
server_key_iv: "8e39942ecac51a196d346655ecd7e32c"
server_key_version: "encryptionkey@0"
I20260811 06:49:42.389834 23567 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260811 06:49:42.393265 23601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:42.394595 23567 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:42.394735 23567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92"
format_stamp: "Formatted at 2026-08-11 06:49:42 on dist-test-slave-7lbf"
server_key: "aa74b0236dd876ecd4d79a38219d16f6"
server_key_iv: "8e39942ecac51a196d346655ecd7e32c"
server_key_version: "encryptionkey@0"
I20260811 06:49:42.394922 23567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:42.410715 23567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:42.414745 23567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:42.415007 23567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:42.415951 23567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:42.417245 23567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:42.417317 23567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:42.417436 23567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:42.417496 23567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:42.453154 23567 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:42157
I20260811 06:49:42.453226 23769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:42157 every 8 connection(s)
I20260811 06:49:42.454452 23567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:49:42.462172 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 23567
I20260811 06:49:42.462342 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:49:42.462769 12868 external_mini_cluster.cc:1428] Setting key 805e9a0947f25cc6fefdb0120bb73cdc
Aug 11 06:49:42 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430982, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:49:42.473927 23561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:42.456999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:47137 (local address 127.12.145.62:38107)
0811 06:49:42.457158 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:42.457163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:42.458398 (+ 1235us) server_negotiation.cc:407] Connection header received
0811 06:49:42.460195 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:42.460201 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:42.460285 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:42.460376 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:42.461894 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:42.462673 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:42.464355 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:42.464883 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:42.464996 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:42.468471 (+ 3475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:42.468476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:42.468480 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:42.468513 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:42.470944 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:42.471672 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:42.471676 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:42.471678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:42.471809 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:42.472232 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:42.472236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:42.472238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:42.472499 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:42.472632 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:42.473323 (+ 691us) server_negotiation.cc:299] Negotiation successful
0811 06:49:42.473588 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 06:49:42.475009 23772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:42.457478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:47137)
0811 06:49:42.458239 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:42.458277 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:42.459910 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:42.460623 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:42.460631 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:42.461128 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:42.461727 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:42.461748 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:42.462828 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:42.462832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:42.464206 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:42.464219 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:42.465111 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:42.465120 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:42.465328 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:42.466015 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:42.466038 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:42.468256 (+ 2218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:42.471082 (+ 2826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:42.471091 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:42.471108 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:42.471547 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:42.471916 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:42.471921 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:42.471925 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:42.472113 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:42.472625 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:42.472632 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:42.472948 (+ 316us) client_negotiation.cc:769] Sending connection context
0811 06:49:42.473190 (+ 242us) client_negotiation.cc:240] Negotiation successful
0811 06:49:42.473771 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":284,"threads_started":1}
I20260811 06:49:42.476446 23770 heartbeater.cc:347] Connected to a master server at 127.12.145.62:38107
I20260811 06:49:42.476727 23770 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:42.477454 23770 heartbeater.cc:511] Master 127.12.145.62:38107 requested a full tablet report, sending...
I20260811 06:49:42.478926 23241 ts_manager.cc:194] Registered new tserver with Master: 6e217cb726ad4e1e8ebe28f38ddb9c92 (127.12.145.2:42157)
I20260811 06:49:42.480011 23241 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:47137
WARNING: no policy specified for oryx/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab.
Entry for principal oryx/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab.
I20260811 06:49:42.514823 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:38107
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab
--principal=oryx/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:42.842303 23778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:42.842586 23778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:42.842727 23778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:42.849953 23778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:42.850066 23778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:42.850219 23778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:49:42.859961 23778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab
--principal=oryx/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:38107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:42.861207 23778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:42.862574 23778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:42.875125 23795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:42.875151 23792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:42.875088 23793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:42.876295 23778 server_base.cc:1034] running on GCE node
I20260811 06:49:42.876873 23778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:42.877790 23778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:42.878981 23778 hybrid_clock.cc:648] HybridClock initialized: now 1786430982878926 us; error 47 us; skew 500 ppm
I20260811 06:49:42.879254 23778 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:42 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430982, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:42.882344 23778 init.cc:377] Logged in from keytab as oryx/127.12.145.3@KRBTEST.COM (short username oryx)
I20260811 06:49:42.883705 23778 webserver.cc:460] Webserver started at http://127.12.145.3:38483/ using document root <none> and password file <none>
I20260811 06:49:42.884337 23778 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:42.884438 23778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:42.884704 23778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:42.887742 23778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "4a5c3b3170b949d2984b60301f7a337d"
format_stamp: "Formatted at 2026-08-11 06:49:42 on dist-test-slave-7lbf"
server_key: "ab71b1b4a09fad617956e01295ad2d98"
server_key_iv: "468e05748693a0458cb71cb203c0fb38"
server_key_version: "encryptionkey@0"
I20260811 06:49:42.888487 23778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "4a5c3b3170b949d2984b60301f7a337d"
format_stamp: "Formatted at 2026-08-11 06:49:42 on dist-test-slave-7lbf"
server_key: "ab71b1b4a09fad617956e01295ad2d98"
server_key_iv: "468e05748693a0458cb71cb203c0fb38"
server_key_version: "encryptionkey@0"
I20260811 06:49:42.893603 23778 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 06:49:42.897079 23808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:42.898435 23778 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:42.898581 23778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "4a5c3b3170b949d2984b60301f7a337d"
format_stamp: "Formatted at 2026-08-11 06:49:42 on dist-test-slave-7lbf"
server_key: "ab71b1b4a09fad617956e01295ad2d98"
server_key_iv: "468e05748693a0458cb71cb203c0fb38"
server_key_version: "encryptionkey@0"
I20260811 06:49:42.898753 23778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:42.937740 23778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:42.942020 23778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:42.942292 23778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:42.943296 23778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:42.944633 23778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:42.944712 23778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:42.944804 23778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:42.944927 23778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:42.977852 23778 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:45279
I20260811 06:49:42.977911 24005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:45279 every 8 connection(s)
I20260811 06:49:42.979213 23778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:49:42.987231 23559 heartbeater.cc:503] Master 127.12.145.62:38107 was elected leader, sending a full tablet report...
I20260811 06:49:42.987989 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 23778
I20260811 06:49:42.988209 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:49:42.988933 12868 external_mini_cluster.cc:1428] Setting key 815b9b9e8ab5874b537cca38bf8707b2
Aug 11 06:49:42 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430982, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:49:42.999228 24008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:42.981703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:47233 (local address 127.12.145.62:38107)
0811 06:49:42.982168 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:42.982173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:42.983019 (+ 846us) server_negotiation.cc:407] Connection header received
0811 06:49:42.984818 (+ 1799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:42.984824 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:42.984905 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:42.985001 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:42.986539 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:42.987394 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:42.989402 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:42.990008 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:42.990138 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:42.993634 (+ 3496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:42.993639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:42.993643 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:42.993676 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:42.996142 (+ 2466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:42.996848 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:42.996853 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:42.996856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:42.996978 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:42.997390 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:42.997393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:42.997396 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:42.997713 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:42.997850 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:42.998598 (+ 748us) server_negotiation.cc:299] Negotiation successful
0811 06:49:42.998822 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":240,"threads_started":1}
I20260811 06:49:43.000182 24009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:42.982180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:47233)
0811 06:49:42.982857 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:42.982902 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:42.984532 (+ 1630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:42.985245 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:42.985253 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:42.985789 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:42.986364 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:42.986383 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:42.987575 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:42.987579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:42.989247 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:42.989262 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:42.990255 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:42.990263 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:42.990497 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:42.991185 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:42.991210 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:42.993395 (+ 2185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:42.996289 (+ 2894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:42.996298 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:42.996315 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:42.996728 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:42.997085 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:42.997090 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:42.997094 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:42.997279 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:42.997836 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:42.997844 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:42.998219 (+ 375us) client_negotiation.cc:769] Sending connection context
0811 06:49:42.998470 (+ 251us) client_negotiation.cc:240] Negotiation successful
0811 06:49:42.999019 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":266,"threads_started":1}
I20260811 06:49:43.001555 24006 heartbeater.cc:347] Connected to a master server at 127.12.145.62:38107
I20260811 06:49:43.001927 24006 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:43.002861 24006 heartbeater.cc:511] Master 127.12.145.62:38107 requested a full tablet report, sending...
I20260811 06:49:43.004477 23241 ts_manager.cc:194] Registered new tserver with Master: 4a5c3b3170b949d2984b60301f7a337d (127.12.145.3:45279)
I20260811 06:49:43.005270 23241 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:47233
I20260811 06:49:43.016299 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.145.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.61.keytab.
Entry for principal oryx/127.12.145.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.61.keytab.
I20260811 06:49:43.069418 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.61:39497
--webserver_interface=127.12.145.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.61.keytab
--principal=oryx/127.12.145.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:38107,127.12.145.61:39497
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:43.392870 24019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:43.393157 24019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:43.393276 24019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:43.400694 24019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:43.400806 24019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:43.400853 24019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:43.400930 24019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:43.400981 24019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:43.411479 24019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:38107,127.12.145.61:39497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.61.keytab
--principal=oryx/127.12.145.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.61:39497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.145.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
W20260811 06:49:43.411844 24019 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.145.62:38107,127.12.145.61:39497'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 06:49:43.412916 24019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:43.414508 24019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:43.425742 24027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:43.425791 24028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:43.425834 24030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:43.426668 24019 server_base.cc:1034] running on GCE node
I20260811 06:49:43.427479 24019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:43.428941 24019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:43.430217 24019 hybrid_clock.cc:648] HybridClock initialized: now 1786430983430138 us; error 32 us; skew 500 ppm
I20260811 06:49:43.430577 24019 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:43 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430983, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:43.433651 24019 init.cc:377] Logged in from keytab as oryx/127.12.145.61@KRBTEST.COM (short username oryx)
I20260811 06:49:43.435055 24019 webserver.cc:460] Webserver started at http://127.12.145.61:35075/ using document root <none> and password file <none>
I20260811 06:49:43.435736 24019 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:43.435835 24019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:43.436133 24019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:43.439069 24019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data/instance:
uuid: "a3d34b77fc8a45a2b90990349f984422"
format_stamp: "Formatted at 2026-08-11 06:49:43 on dist-test-slave-7lbf"
server_key: "127ee538c30b46500a1eb07dac832fb7"
server_key_iv: "07ce312b1812bfd92cf2b02fbeeba520"
server_key_version: "encryptionkey@0"
I20260811 06:49:43.439910 24019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal/instance:
uuid: "a3d34b77fc8a45a2b90990349f984422"
format_stamp: "Formatted at 2026-08-11 06:49:43 on dist-test-slave-7lbf"
server_key: "127ee538c30b46500a1eb07dac832fb7"
server_key_iv: "07ce312b1812bfd92cf2b02fbeeba520"
server_key_version: "encryptionkey@0"
I20260811 06:49:43.445086 24019 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:49:43.448438 24043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:43.449843 24019 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:43.450001 24019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal
uuid: "a3d34b77fc8a45a2b90990349f984422"
format_stamp: "Formatted at 2026-08-11 06:49:43 on dist-test-slave-7lbf"
server_key: "127ee538c30b46500a1eb07dac832fb7"
server_key_iv: "07ce312b1812bfd92cf2b02fbeeba520"
server_key_version: "encryptionkey@0"
I20260811 06:49:43.450188 24019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:43.469900 24019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:43.473855 24019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:43.474086 24019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:43.483098 23770 heartbeater.cc:503] Master 127.12.145.62:38107 was elected leader, sending a full tablet report...
I20260811 06:49:43.491703 24019 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.61:39497
I20260811 06:49:43.491720 24128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.61:39497 every 8 connection(s)
I20260811 06:49:43.492995 24019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
I20260811 06:49:43.496562 24129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:43.501827 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 24019
I20260811 06:49:43.503930 24129 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:49:43 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.61@KRBTEST.COM
Aug 11 06:49:43 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430983, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.61@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:49:43.524998 24137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.506646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35786 (local address 127.12.145.62:38107)
0811 06:49:43.507127 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:43.507169 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:43.509783 (+ 2614us) server_negotiation.cc:407] Connection header received
0811 06:49:43.510120 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:43.510127 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:43.510208 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:43.510311 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:43.511702 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.512859 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.514680 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.515315 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.515451 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.518697 (+ 3246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:43.518703 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:43.518707 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:43.518749 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:43.521855 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.522633 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.522637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.522639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.522756 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.523145 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.523150 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.523153 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.523562 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:43.523700 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:43.524373 (+ 673us) server_negotiation.cc:299] Negotiation successful
0811 06:49:43.524603 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":228,"threads_started":1}
I20260811 06:49:43.525838 24138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.506675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:35786)
0811 06:49:43.509651 (+ 2976us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:43.509693 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:43.509920 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:43.510438 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:43.510446 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:43.511246 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:43.511558 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.511567 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.512977 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.512982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.514520 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.514534 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.515515 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.515520 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.515637 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.516134 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:43.516155 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:43.518511 (+ 2356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:43.521981 (+ 3470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.521994 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.522006 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.522510 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.522862 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.522865 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.522867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.523023 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.523680 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:43.523688 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:43.523939 (+ 251us) client_negotiation.cc:769] Sending connection context
0811 06:49:43.524209 (+ 270us) client_negotiation.cc:240] Negotiation successful
0811 06:49:43.524777 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2657,"mutex_wait_us":124,"thread_start_us":2502,"threads_started":1}
I20260811 06:49:43.525858 24135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.504199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33246 (local address 127.12.145.61:39497)
0811 06:49:43.504965 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:43.504977 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:43.505018 (+ 41us) server_negotiation.cc:407] Connection header received
0811 06:49:43.506775 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:43.506805 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:43.507294 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:43.507614 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:43.509118 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.511126 (+ 2008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.512850 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.513884 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.514056 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.518256 (+ 4200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:43.518264 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:43.518275 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:43.518305 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:43.521576 (+ 3271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.522301 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.522307 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.522310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.522471 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.522847 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.522852 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.522855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.523522 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:43.523812 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:43.524189 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 06:49:43.524620 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":340,"threads_started":1}
I20260811 06:49:43.527731 24129 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:49:43 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430983, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.61@KRBTEST.COM for oryx/127.12.145.61@KRBTEST.COM
I20260811 06:49:43.539155 24138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.528548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39497 (local address 127.0.0.1:33248)
0811 06:49:43.528712 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:43.528727 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:43.528805 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:43.529128 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:43.529132 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:43.529444 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:43.529619 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.529629 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.530586 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.530591 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.531449 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.531461 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.532068 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.532072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.532224 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.532683 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:43.532699 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:43.534557 (+ 1858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:43.537157 (+ 2600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.537161 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.537163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.537575 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.537885 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.537888 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.537890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.538012 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.538480 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:43.538484 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:43.538594 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 06:49:43.538694 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 06:49:43.538924 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 06:49:43.539286 24135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.528548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33248 (local address 127.12.145.61:39497)
0811 06:49:43.528937 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:43.528941 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:43.528950 (+ 9us) server_negotiation.cc:407] Connection header received
0811 06:49:43.528976 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:43.528979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:43.529021 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:43.529079 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:43.529745 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.530438 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.531571 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.531954 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.532040 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.534714 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:43.534719 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:43.534722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:43.534750 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:43.537038 (+ 2288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.537665 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.537669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.537671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.537778 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.538103 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.538107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.538108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.538363 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:43.538474 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:43.538772 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 06:49:43.539029 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":93,"server-negotiator.queue_time_us":311}
I20260811 06:49:43.543880 24129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: Bootstrap starting.
I20260811 06:49:43.546957 24129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:43.547955 24129 log.cc:824] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:43.550611 24129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: No bootstrap required, opened a new log
I20260811 06:49:43.557682 24129 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } }
I20260811 06:49:43.558012 24129 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:43.558113 24129 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d34b77fc8a45a2b90990349f984422, State: Initialized, Role: FOLLOWER
I20260811 06:49:43.558688 24129 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } }
I20260811 06:49:43.559502 24143 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } }
I20260811 06:49:43.559794 24143 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:49:43.560423 24129 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 06:49:43.569311 24160 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:43.569471 24160 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:43.572268 24019 master_runner.cc:428] Detected that this master a3d34b77fc8a45a2b90990349f984422 is joining an existing cluster
I20260811 06:49:43.572373 24019 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.145.61:39497
I20260811 06:49:43.585680 24143 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:43.586021 24143 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } }
I20260811 06:49:43.587472 24143 leader_election.cc:288] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107)
I20260811 06:49:43.588421 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a3d34b77fc8a45a2b90990349f984422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9648bd90acc94b9eb272c8cd354f5276" is_pre_election: true
I20260811 06:49:43.589689 24049 leader_election.cc:302] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a3d34b77fc8a45a2b90990349f984422; no voters: 9648bd90acc94b9eb272c8cd354f5276
I20260811 06:49:43.590427 24143 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:49:43.593434 24135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.577023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33258 (local address 127.12.145.61:39497)
0811 06:49:43.577209 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:43.577217 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:43.578489 (+ 1272us) server_negotiation.cc:407] Connection header received
0811 06:49:43.578643 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:43.578648 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:43.578717 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:43.578822 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:43.580297 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.581355 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.583530 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.584096 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.584178 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.586846 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:43.586852 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:43.586857 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:43.586888 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:43.590712 (+ 3824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.591491 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.591495 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.591498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.591630 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.591983 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.591987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.591993 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.592338 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:43.592471 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:43.592898 (+ 427us) server_negotiation.cc:299] Negotiation successful
0811 06:49:43.593094 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:49:43.593732 24137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.577107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35794 (local address 127.12.145.62:38107)
0811 06:49:43.577268 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:43.577274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:43.578107 (+ 833us) server_negotiation.cc:407] Connection header received
0811 06:49:43.578449 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:43.578455 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:43.578554 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:43.578659 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:43.580295 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.581379 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.583574 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.584223 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.584330 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.586967 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:43.586974 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:43.586979 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:43.587018 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:43.590507 (+ 3489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.591382 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.591388 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.591392 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.591545 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.592025 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.592029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.592033 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.592382 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:43.592533 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:43.593140 (+ 607us) server_negotiation.cc:299] Negotiation successful
0811 06:49:43.593377 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:49:43.594304 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.576653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39497 (local address 127.0.0.1:33258)
0811 06:49:43.578398 (+ 1745us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:43.578418 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:43.578532 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:43.578986 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:43.578990 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:43.579737 (+ 747us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:43.580161 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.580174 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.581768 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.581773 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.583392 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.583409 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.584438 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.584443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.584605 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.585387 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:43.585415 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:43.586665 (+ 1250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:43.590848 (+ 4183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.590852 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.590855 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.591384 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.591738 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.591745 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.591748 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.591893 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.592528 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:43.592532 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:43.592658 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 06:49:43.593604 (+ 946us) client_negotiation.cc:240] Negotiation successful
0811 06:49:43.593883 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1626,"mutex_wait_us":68,"spinlock_wait_cycles":20224,"thread_start_us":1460,"threads_started":1}
I20260811 06:49:43.594755 24178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.576630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:35794)
0811 06:49:43.577992 (+ 1362us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:43.578012 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:43.578239 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:43.578859 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:43.578865 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:43.579607 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:43.580106 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.580121 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.581582 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.581587 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.583387 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.583407 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.584619 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.584625 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.584817 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.585334 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:43.585358 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:43.586732 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:43.590678 (+ 3946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.590683 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.590687 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.591224 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.591694 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.591699 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.591703 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.591887 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.592617 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:43.592622 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:43.592821 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 06:49:43.593978 (+ 1157us) client_negotiation.cc:240] Negotiation successful
0811 06:49:43.594313 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1221,"mutex_wait_us":32,"spinlock_wait_cycles":1408,"thread_start_us":1056,"threads_started":1}
Aug 11 06:49:43 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430981, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.62@KRBTEST.COM for oryx/127.12.145.61@KRBTEST.COM
WARNING: no policy specified for oryx/127.12.145.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.60@KRBTEST.COM" created.
I20260811 06:49:43.619221 24181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.601082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39497 (local address 127.0.0.1:33264)
0811 06:49:43.601726 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:43.601775 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:43.602012 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:43.602689 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:43.602696 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:43.603565 (+ 869us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:43.603885 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.603900 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.605306 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.605311 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.607001 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.607019 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.608102 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.608109 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.608308 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.609028 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:43.609058 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:43.612011 (+ 2953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:43.615964 (+ 3953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.615978 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.615986 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.616550 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.617034 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.617039 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.617043 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.617212 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.618006 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:43.618015 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:43.618223 (+ 208us) client_negotiation.cc:769] Sending connection context
0811 06:49:43.618427 (+ 204us) client_negotiation.cc:240] Negotiation successful
0811 06:49:43.618765 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":554,"threads_started":1}
I20260811 06:49:43.620069 24135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.601442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33264 (local address 127.12.145.61:39497)
0811 06:49:43.601623 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:43.601628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:43.601868 (+ 240us) server_negotiation.cc:407] Connection header received
0811 06:49:43.602254 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:43.602260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:43.602345 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:43.602421 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:43.604058 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.605163 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.607138 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.607902 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.608019 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.612244 (+ 4225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:43.612251 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:43.612256 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:43.612295 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:43.615781 (+ 3486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.616708 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.616714 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.616718 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.616891 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.617363 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.617368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.617371 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.617759 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:43.617921 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:43.619470 (+ 1549us) server_negotiation.cc:299] Negotiation successful
0811 06:49:43.619694 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 06:49:43.622081 23241 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.145.61:39497: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a3d34b77fc8a45a2b90990349f984422"
member_type: NON_VOTER
last_known_addr {
host: "127.12.145.61"
port: 39497
}
attrs {
promote: true
}
}
dest_uuid: "9648bd90acc94b9eb272c8cd354f5276"
cas_config_opid_index: -1
I20260811 06:49:43.623276 23241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } }
I20260811 06:49:43.634250 24088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:43.637884 24088 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Refusing update from remote peer 9648bd90acc94b9eb272c8cd354f5276: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 06:49:43.638254 24190 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a3d34b77fc8a45a2b90990349f984422 (127.12.145.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } } }
I20260811 06:49:43.639719 24191 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:43.649461 24190 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.145.61:39497
I20260811 06:49:43.650489 24019 master.cc:537] Master@127.12.145.61:39497 shutting down...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.60.keytab.
Entry for principal oryx/127.12.145.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.60.keytab.
I20260811 06:49:43.655512 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.60:36287
--webserver_interface=127.12.145.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.60.keytab
--principal=oryx/127.12.145.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:38107,127.12.145.61:39497,127.12.145.60:36287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:49:43.657923 24192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } } }
I20260811 06:49:43.658483 24192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:43.669644 24088 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a3d34b77fc8a45a2b90990349f984422 (127.12.145.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } } }
I20260811 06:49:43.693738 24209 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } } }
I20260811 06:49:43.694108 24209 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: This master's current role is: LEARNER
I20260811 06:49:43.694233 24143 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9648bd90acc94b9eb272c8cd354f5276. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } } }
I20260811 06:49:43.694490 24143 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: This master's current role is: LEARNER
I20260811 06:49:43.694468 24200 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } } }
I20260811 06:49:43.694773 24200 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: This master's current role is: LEARNER
I20260811 06:49:43.697880 24019 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 LEARNER]: Raft consensus shutting down.
I20260811 06:49:43.698403 24019 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 LEARNER]: Raft consensus is shut down!
I20260811 06:49:43.698565 24019 tablet_replica.cc:330] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: stopping tablet replica
I20260811 06:49:43.707443 24019 master.cc:552] Master@127.12.145.61:39497 shutdown complete.
I20260811 06:49:43.707625 24019 master_runner.cc:305] Clearing existing system tablet
I20260811 06:49:43.708132 24019 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:43.708237 24019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:43.711400 24019 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 06:49:43.717886 24211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:43.718247 24019 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:43.718549 24019 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.005s
I20260811 06:49:43.718647 24019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal
uuid: "a3d34b77fc8a45a2b90990349f984422"
format_stamp: "Formatted at 2026-08-11 06:49:43 on dist-test-slave-7lbf"
server_key: "127ee538c30b46500a1eb07dac832fb7"
server_key_iv: "07ce312b1812bfd92cf2b02fbeeba520"
server_key_version: "encryptionkey@0"
I20260811 06:49:43.724123 24019 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:43.731109 24019 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 06:49:43.731304 24019 log.cc:1196] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 06:49:43.731812 24019 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: Deleting consensus metadata
I20260811 06:49:43.732103 24019 master_runner.cc:315] Copying system tablet from 127.12.145.62:38107
I20260811 06:49:43.734732 24019 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: tablet copy: Beginning tablet copy session from remote peer at address 127.12.145.62:38107
I20260811 06:49:43.753100 24137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.735767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35808 (local address 127.12.145.62:38107)
0811 06:49:43.735978 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:43.735984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:43.738172 (+ 2188us) server_negotiation.cc:407] Connection header received
0811 06:49:43.738360 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:43.738366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:43.738470 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:43.738582 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:43.739625 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.740818 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.743010 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.743692 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.743837 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.746363 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:43.746372 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:43.746377 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:43.746421 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:43.749918 (+ 3497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.750806 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.750812 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.750815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.750969 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:43.751418 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:43.751423 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:43.751427 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:43.751793 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:43.751945 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:43.752493 (+ 548us) server_negotiation.cc:299] Negotiation successful
0811 06:49:43.752721 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 06:49:43.753147 24218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:43.735680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:35808)
0811 06:49:43.738031 (+ 2351us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:43.738053 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:43.738218 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:43.738636 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:43.738642 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:43.739154 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:43.739446 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.739460 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.740981 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.740987 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.742790 (+ 1803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:43.742808 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:43.743884 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:43.743891 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:43.744068 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:43.744940 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:43.744965 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:43.746124 (+ 1159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:43.750086 (+ 3962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.750119 (+ 33us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.750123 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.750661 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.751096 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:43.751102 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:43.751105 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:43.751276 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:43.751949 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:43.751955 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:43.752158 (+ 203us) client_negotiation.cc:769] Sending connection context
0811 06:49:43.752346 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 06:49:43.752713 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2211,"thread_start_us":2039,"threads_started":1}
I20260811 06:49:43.754370 23267 tablet_copy_service.cc:140] P 9648bd90acc94b9eb272c8cd354f5276: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a3d34b77fc8a45a2b90990349f984422 ({username='oryx', principal='oryx/127.12.145.61@KRBTEST.COM'} at 127.0.0.1:35808)
I20260811 06:49:43.754650 23267 tablet_copy_service.cc:161] P 9648bd90acc94b9eb272c8cd354f5276: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a3d34b77fc8a45a2b90990349f984422 at {username='oryx', principal='oryx/127.12.145.61@KRBTEST.COM'} at 127.0.0.1:35808: session id = a3d34b77fc8a45a2b90990349f984422-00000000000000000000000000000000
I20260811 06:49:43.759204 23267 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 06:49:43.761590 24019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 06:49:43.768419 24019 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: tablet copy: Starting download of 0 data blocks...
I20260811 06:49:43.768788 24019 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: tablet copy: Starting download of 1 WAL segments...
I20260811 06:49:43.771713 24019 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 06:49:43.776209 23267 tablet_copy_service.cc:342] P 9648bd90acc94b9eb272c8cd354f5276: Request end of tablet copy session a3d34b77fc8a45a2b90990349f984422-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.145.61@KRBTEST.COM'} at 127.0.0.1:35808
I20260811 06:49:43.776407 23267 tablet_copy_service.cc:433] P 9648bd90acc94b9eb272c8cd354f5276: ending tablet copy session a3d34b77fc8a45a2b90990349f984422-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a3d34b77fc8a45a2b90990349f984422
I20260811 06:49:43.788123 24019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:43.790686 24219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:43.794792 24220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:43.801959 24223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:43.802278 24019 server_base.cc:1034] running on GCE node
I20260811 06:49:43.802781 24019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:43.803702 24019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:43.804970 24019 hybrid_clock.cc:648] HybridClock initialized: now 1786430983804880 us; error 50 us; skew 500 ppm
I20260811 06:49:43.805202 24019 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:43 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430983, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:43.807375 24019 init.cc:377] Logged in from keytab as oryx/127.12.145.61@KRBTEST.COM (short username oryx)
I20260811 06:49:43.808753 24019 webserver.cc:460] Webserver started at http://127.12.145.61:41247/ using document root <none> and password file <none>
I20260811 06:49:43.809114 24019 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:43.809203 24019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:43.812490 24019 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 06:49:43.814563 24234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:43.814945 24019 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 06:49:43.815079 24019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal
uuid: "a3d34b77fc8a45a2b90990349f984422"
format_stamp: "Formatted at 2026-08-11 06:49:43 on dist-test-slave-7lbf"
server_key: "127ee538c30b46500a1eb07dac832fb7"
server_key_iv: "07ce312b1812bfd92cf2b02fbeeba520"
server_key_version: "encryptionkey@0"
I20260811 06:49:43.815236 24019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:43.839762 24019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:43.843945 24019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:43.866590 24019 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.61:39497
I20260811 06:49:43.866624 24319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.61:39497 every 8 connection(s)
I20260811 06:49:43.867674 24019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
I20260811 06:49:43.873292 24321 sys_catalog.cc:263] Verifying existing consensus state
I20260811 06:49:43.877897 24321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: Bootstrap starting.
I20260811 06:49:43.894328 24321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 06:49:43.894887 24321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: Bootstrap complete.
I20260811 06:49:43.895973 24321 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } }
I20260811 06:49:43.896252 24321 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a3d34b77fc8a45a2b90990349f984422, State: Initialized, Role: LEARNER
I20260811 06:49:43.896641 24321 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } }
I20260811 06:49:43.897599 24326 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } } }
I20260811 06:49:43.898041 24326 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: This master's current role is: LEARNER
I20260811 06:49:43.898046 24321 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:43.910454 24342 catalog_manager.cc:1259] Loaded cluster ID: 3ded78ee6ea14827a36d02142afebf92
I20260811 06:49:43.910583 24342 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: loading cluster ID for follower catalog manager: success
I20260811 06:49:43.914191 24342 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: acquiring CA information for follower catalog manager: success
I20260811 06:49:43.916807 24342 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 06:49:44.007776 24006 heartbeater.cc:503] Master 127.12.145.62:38107 was elected leader, sending a full tablet report...
W20260811 06:49:44.042176 24207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:44.042479 24207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:44.042609 24207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:44.049932 24207 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:49:44.050045 24207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:44.050122 24207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:44.050200 24207 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:49:44.050261 24207 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:49:44.059857 24207 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:38107,127.12.145.61:39497,127.12.145.60:36287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.60.keytab
--principal=oryx/127.12.145.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.60:36287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.145.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:44.061116 24207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:44.062403 24207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:44.073992 24353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:44.073971 24354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:44.074000 24356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:44.074990 24207 server_base.cc:1034] running on GCE node
I20260811 06:49:44.075737 24207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:44.077068 24207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:44.078259 24207 hybrid_clock.cc:648] HybridClock initialized: now 1786430984078209 us; error 40 us; skew 500 ppm
I20260811 06:49:44.078570 24207 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430984, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:44.081490 24207 init.cc:377] Logged in from keytab as oryx/127.12.145.60@KRBTEST.COM (short username oryx)
I20260811 06:49:44.082935 24207 webserver.cc:460] Webserver started at http://127.12.145.60:41801/ using document root <none> and password file <none>
I20260811 06:49:44.083563 24207 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:44.083681 24207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:44.084012 24207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:49:44.086956 24207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/data/instance:
uuid: "446c9e60cef64b7eb97cfdc7245683fe"
format_stamp: "Formatted at 2026-08-11 06:49:44 on dist-test-slave-7lbf"
server_key: "b0c105e476122b20da2e9d69fc7ae2a5"
server_key_iv: "55c4721f84452d13d09b643f570f9e5d"
server_key_version: "encryptionkey@0"
I20260811 06:49:44.087692 24207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/wal/instance:
uuid: "446c9e60cef64b7eb97cfdc7245683fe"
format_stamp: "Formatted at 2026-08-11 06:49:44 on dist-test-slave-7lbf"
server_key: "b0c105e476122b20da2e9d69fc7ae2a5"
server_key_iv: "55c4721f84452d13d09b643f570f9e5d"
server_key_version: "encryptionkey@0"
I20260811 06:49:44.092689 24207 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 06:49:44.096203 24366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:44.097604 24207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:49:44.097749 24207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/wal
uuid: "446c9e60cef64b7eb97cfdc7245683fe"
format_stamp: "Formatted at 2026-08-11 06:49:44 on dist-test-slave-7lbf"
server_key: "b0c105e476122b20da2e9d69fc7ae2a5"
server_key_iv: "55c4721f84452d13d09b643f570f9e5d"
server_key_version: "encryptionkey@0"
I20260811 06:49:44.097923 24207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:44.133297 24207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:44.137202 24207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:44.137507 24207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:44.155851 24207 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.60:36287
I20260811 06:49:44.155927 24448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.60:36287 every 8 connection(s)
I20260811 06:49:44.157279 24207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
I20260811 06:49:44.160972 24449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:44.167265 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 24207
I20260811 06:49:44.167554 24449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430984, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.60@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.60@KRBTEST.COM
I20260811 06:49:44.187575 24137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.170648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35816 (local address 127.12.145.62:38107)
0811 06:49:44.170796 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:44.170802 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:44.171349 (+ 547us) server_negotiation.cc:407] Connection header received
0811 06:49:44.172347 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:44.172352 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:44.172433 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:44.172553 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:44.174174 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.175315 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.177286 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.177831 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.177957 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.181634 (+ 3677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:44.181639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:44.181642 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:44.181676 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:44.184284 (+ 2608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.185209 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.185213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.185215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.185389 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.185899 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.185904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.185907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.186299 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:44.186468 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:44.187173 (+ 705us) server_negotiation.cc:299] Negotiation successful
0811 06:49:44.187334 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 06:49:44.188706 24455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.170404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:35816)
0811 06:49:44.171173 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:44.171225 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:44.172098 (+ 873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:44.172598 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:44.172604 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:44.173439 (+ 835us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:44.173999 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.174025 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.175464 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.175469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.177139 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.177154 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.178038 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.178044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.178229 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.178874 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:44.178903 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:44.181430 (+ 2527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:44.184407 (+ 2977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.184424 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.184436 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.185111 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.185505 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.185510 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.185534 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.185779 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.186426 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:44.186431 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:44.186767 (+ 336us) client_negotiation.cc:769] Sending connection context
0811 06:49:44.187046 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 06:49:44.187500 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":300,"threads_started":1}
I20260811 06:49:44.189088 24454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.169426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34910 (local address 127.12.145.60:36287)
0811 06:49:44.170103 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:44.170113 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:44.170149 (+ 36us) server_negotiation.cc:407] Connection header received
0811 06:49:44.172090 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:44.172112 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:44.172431 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:44.172631 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:44.174352 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.175868 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.177495 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.178238 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.178343 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.182832 (+ 4489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:44.182840 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:44.182851 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:44.182878 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:44.185817 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.186624 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.186630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.186633 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.186781 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.187110 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.187114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.187117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.187517 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:44.187794 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:44.188534 (+ 740us) server_negotiation.cc:299] Negotiation successful
0811 06:49:44.188706 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":286,"threads_started":1}
I20260811 06:49:44.190575 24449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430984, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.60@KRBTEST.COM for oryx/127.12.145.61@KRBTEST.COM
I20260811 06:49:44.204094 24458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.191499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33278 (local address 127.12.145.61:39497)
0811 06:49:44.192077 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:44.192081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:44.192096 (+ 15us) server_negotiation.cc:407] Connection header received
0811 06:49:44.192145 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:44.192148 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:44.192203 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:44.192381 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:44.193011 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.194023 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.195223 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.195618 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.195705 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.198768 (+ 3063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:44.198775 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:44.198780 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:44.198814 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:44.201342 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.202174 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.202179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.202181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.202317 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.202718 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.202723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.202726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.203085 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:44.203220 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:44.203612 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 06:49:44.203775 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":331,"threads_started":1}
I20260811 06:49:44.204154 24455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.191533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39497 (local address 127.0.0.1:33278)
0811 06:49:44.191881 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:44.191902 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:44.192002 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:44.192403 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:44.192406 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:44.192716 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:44.192887 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.192896 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.194159 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.194163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.195108 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.195120 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.195738 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.195743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.195912 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.196400 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:44.196424 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:44.198552 (+ 2128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:44.201468 (+ 2916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.201472 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.201474 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.202068 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.202458 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.202463 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.202467 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.202613 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.203212 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:44.203215 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:44.203375 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 06:49:44.203519 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 06:49:44.203778 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168}
I20260811 06:49:44.205686 24449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430984, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.60@KRBTEST.COM for oryx/127.12.145.60@KRBTEST.COM
I20260811 06:49:44.217443 24455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.206330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36287 (local address 127.0.0.1:34920)
0811 06:49:44.206477 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:44.206491 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:44.206578 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:44.206875 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:44.206878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:44.207218 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:44.207366 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.207375 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.208273 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.208277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.209281 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.209293 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.209978 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.209983 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.210164 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.210650 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:44.210666 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:44.212552 (+ 1886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:44.215176 (+ 2624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.215182 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.215186 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.215553 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.215880 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.215885 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.215889 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.216041 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.216533 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:44.216538 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:44.216676 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 06:49:44.216788 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 06:49:44.217041 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 06:49:44.217478 24454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.206490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34920 (local address 127.12.145.60:36287)
0811 06:49:44.206635 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:44.206641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:44.206655 (+ 14us) server_negotiation.cc:407] Connection header received
0811 06:49:44.206691 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:44.206695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:44.206739 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:44.206837 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:44.207486 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.208156 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.209390 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.209826 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.209919 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.212712 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:44.212717 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:44.212720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:44.212746 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:44.215059 (+ 2313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.215652 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.215657 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.215661 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.215785 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.216139 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.216143 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.216146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.216426 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:44.216555 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:44.216880 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 06:49:44.217179 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":109,"server-negotiator.queue_time_us":50}
I20260811 06:49:44.222347 24449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: Bootstrap starting.
I20260811 06:49:44.225415 24449 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:44.226485 24449 log.cc:824] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:44.229065 24449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: No bootstrap required, opened a new log
I20260811 06:49:44.236423 24460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } } }
I20260811 06:49:44.236876 24460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:44.236960 24449 raft_consensus.cc:348] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } peers { permanent_uuid: "446c9e60cef64b7eb97cfdc7245683fe" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } }
I20260811 06:49:44.237597 24449 raft_consensus.cc:374] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:44.237780 24449 raft_consensus.cc:729] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 446c9e60cef64b7eb97cfdc7245683fe, State: Initialized, Role: FOLLOWER
I20260811 06:49:44.238662 24449 consensus_queue.cc:260] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } peers { permanent_uuid: "446c9e60cef64b7eb97cfdc7245683fe" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } }
I20260811 06:49:44.244746 24469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } peers { permanent_uuid: "446c9e60cef64b7eb97cfdc7245683fe" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } } }
I20260811 06:49:44.245178 24469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:49:44.246199 24449 sys_catalog.cc:564] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:49:44.250066 24458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.237096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33286 (local address 127.12.145.61:39497)
0811 06:49:44.237319 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:44.237326 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:44.244181 (+ 6855us) server_negotiation.cc:407] Connection header received
0811 06:49:44.244529 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:44.244535 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:44.244658 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:44.244777 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:44.245316 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.246402 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.248145 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.249106 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.249234 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.249462 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:44.249683 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 06:49:44.249817 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 06:49:44.250133 24467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.236612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39497 (local address 127.0.0.1:33286)
0811 06:49:44.243943 (+ 7331us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:44.243966 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:44.244316 (+ 350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:44.244861 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:44.244866 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:44.244897 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:44.245134 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.245147 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.246536 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.246539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.247991 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.248004 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.249277 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.249282 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.249479 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.249562 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 06:49:44.249648 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 06:49:44.249784 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7204,"thread_start_us":7100,"threads_started":1}
I20260811 06:49:44.251178 24326 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9648bd90acc94b9eb272c8cd354f5276. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: NON_VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: true } } }
I20260811 06:49:44.251427 24326 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: This master's current role is: LEARNER
I20260811 06:49:44.252048 24463 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276: attempting to promote NON_VOTER a3d34b77fc8a45a2b90990349f984422 to VOTER
I20260811 06:49:44.252867 24463 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } }
I20260811 06:49:44.254760 24282 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 LEARNER]: Refusing update from remote peer 9648bd90acc94b9eb272c8cd354f5276: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 06:49:44.255369 24460 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 06:49:44.256645 24207 master_runner.cc:240] Existing masters have pending config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } }
I20260811 06:49:44.257179 24207 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 06:49:44.258422 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:44.258612 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:44.258546 24463 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, a3d34b77fc8a45a2b90990349f984422 (127.12.145.61) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } } }
I20260811 06:49:44.259143 24282 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, a3d34b77fc8a45a2b90990349f984422 (127.12.145.61) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } } }
I20260811 06:49:44.261912 24326 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } } }
I20260811 06:49:44.262080 24326 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:49:44.262385 24463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } } }
I20260811 06:49:44.262722 24463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:44.262360 24465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9648bd90acc94b9eb272c8cd354f5276" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } } }
I20260811 06:49:44.262876 24465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276 [sys.catalog]: This master's current role is: LEADER
I20260811 06:49:44.295198 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 23347
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.1@KRBTEST.COM
I20260811 06:49:44.314705 24489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.296342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48398 (local address 127.12.145.1:37049)
0811 06:49:44.297197 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:44.297208 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:44.297243 (+ 35us) server_negotiation.cc:407] Connection header received
0811 06:49:44.297332 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:44.297342 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:44.297661 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:44.297943 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:44.299529 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.300581 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.302250 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.302945 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.303774 (+ 829us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.308785 (+ 5011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:44.308797 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:44.308813 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:44.308852 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:44.311675 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.312461 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.312468 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.312470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.312618 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.313043 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.313046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.313049 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.313440 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:44.313736 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:44.314028 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 06:49:44.314313 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":444,"threads_started":1}
I20260811 06:49:44.316192 23552 generic_service.cc:196] Checking for leaks (request via RPC)
W20260811 06:49:44.389698 24374 tablet.cc:2369] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:49:44.405584 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 23347
I20260811 06:49:44.430094 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:37049
--local_ip_for_outbound_sockets=127.12.145.1
--tserver_master_addrs=127.12.145.62:38107
--webserver_port=39695
--webserver_interface=127.12.145.1
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab
--principal=oryx/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.145.62:38107,127.12.145.61:39497
--tserver_master_addrs=127.12.145.62:38107,127.12.145.61:39497,127.12.145.60:36287 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:49:44.596127 24469 raft_consensus.cc:482] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:44.596525 24469 raft_consensus.cc:504] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } peers { permanent_uuid: "446c9e60cef64b7eb97cfdc7245683fe" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } }
I20260811 06:49:44.598613 24469 leader_election.cc:288] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107), a3d34b77fc8a45a2b90990349f984422 (127.12.145.61:39497)
I20260811 06:49:44.599174 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "446c9e60cef64b7eb97cfdc7245683fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9648bd90acc94b9eb272c8cd354f5276" is_pre_election: true
I20260811 06:49:44.599918 24282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "446c9e60cef64b7eb97cfdc7245683fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d34b77fc8a45a2b90990349f984422" is_pre_election: true
I20260811 06:49:44.600811 24369 leader_election.cc:302] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446c9e60cef64b7eb97cfdc7245683fe; no voters: 9648bd90acc94b9eb272c8cd354f5276, a3d34b77fc8a45a2b90990349f984422
I20260811 06:49:44.601552 24469 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:49:44.775665 24491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:44.776082 24491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:44.776248 24491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:44.783703 24491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:44.783818 24491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:44.783967 24491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:49:44.796411 24491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab
--principal=oryx/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:37049
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=39695
--tserver_master_addrs=127.12.145.62:38107,127.12.145.61:39497,127.12.145.60:36287
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:44.797748 24491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:44.799191 24491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:44.813042 24501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:44.812960 24497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:44.812997 24505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:44.813772 24491 server_base.cc:1034] running on GCE node
I20260811 06:49:44.814306 24491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:44.815174 24491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:44.816365 24491 hybrid_clock.cc:648] HybridClock initialized: now 1786430984816307 us; error 52 us; skew 500 ppm
I20260811 06:49:44.816622 24491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430984, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:44.819780 24491 init.cc:377] Logged in from keytab as oryx/127.12.145.1@KRBTEST.COM (short username oryx)
I20260811 06:49:44.821165 24491 webserver.cc:460] Webserver started at http://127.12.145.1:39695/ using document root <none> and password file <none>
I20260811 06:49:44.821871 24491 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:44.821998 24491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:44.827224 24491 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 06:49:44.829989 24516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:44.831279 24491 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:49:44.831425 24491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "7661e41354ed4534afc935a0bf9c6249"
format_stamp: "Formatted at 2026-08-11 06:49:41 on dist-test-slave-7lbf"
server_key: "b4e4ea9f5c34770dbadf9e2ad656b1b9"
server_key_iv: "eeb5deb5a9d70f852835ac5eaf093072"
server_key_version: "encryptionkey@0"
I20260811 06:49:44.832472 24491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:44.850420 24491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:44.854207 24491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:44.854466 24491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:44.855386 24491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:44.856767 24491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:44.856870 24491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:44.856972 24491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:44.857045 24491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:44.890587 24491 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:37049
I20260811 06:49:44.890636 24696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:37049 every 8 connection(s)
I20260811 06:49:44.892060 24491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:49:44.894626 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 24491
I20260811 06:49:44.894956 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 23567
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.2@KRBTEST.COM
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430984, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.60@KRBTEST.COM
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430984, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.61@KRBTEST.COM
Aug 11 06:49:44 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430984, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:49:44.931476 24714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.896415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35074 (local address 127.12.145.2:42157)
0811 06:49:44.909729 (+ 13314us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:44.909735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:44.909758 (+ 23us) server_negotiation.cc:407] Connection header received
0811 06:49:44.909814 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:44.909821 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:44.910046 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:44.910187 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:44.912253 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.913913 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.915796 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.916629 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.916756 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.923306 (+ 6550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:44.923323 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:44.923341 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:44.923402 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:44.927849 (+ 4447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.928786 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.928795 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.928799 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.928973 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.929409 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.929415 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.929418 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.929893 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:44.930205 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:44.930765 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 06:49:44.931061 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13149,"thread_start_us":12104,"threads_started":1}
I20260811 06:49:44.932576 24713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.896241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:52141 (local address 127.12.145.60:36287)
0811 06:49:44.908077 (+ 11836us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:44.908083 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:44.908109 (+ 26us) server_negotiation.cc:407] Connection header received
0811 06:49:44.911267 (+ 3158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:44.911274 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:44.911376 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:44.911863 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:44.914573 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.915741 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.918258 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.918881 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.918970 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.925283 (+ 6313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:44.925289 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:44.925293 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:44.925331 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:44.928614 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.929746 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.929751 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.929755 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.929917 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.930437 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.930442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.930445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.930868 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:44.931014 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:44.932000 (+ 986us) server_negotiation.cc:299] Negotiation successful
0811 06:49:44.932221 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11709,"thread_start_us":11618,"threads_started":1}
I20260811 06:49:44.932610 24717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.908767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:45895 (local address 127.12.145.62:38107)
0811 06:49:44.909246 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:44.909252 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:44.913951 (+ 4699us) server_negotiation.cc:407] Connection header received
0811 06:49:44.914238 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:44.914243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:44.914335 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:44.914565 (+ 230us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:44.915770 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.916790 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.918637 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.919264 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.919364 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.925134 (+ 5770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:44.925141 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:44.925145 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:44.925187 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:44.928775 (+ 3588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.929801 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.929807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.929810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.929959 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.930468 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.930473 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.930476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.930847 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:44.930989 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:44.931997 (+ 1008us) server_negotiation.cc:299] Negotiation successful
0811 06:49:44.932229 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":267,"threads_started":1}
I20260811 06:49:44.933056 23759 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:44.933934 24716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.908648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:45895)
0811 06:49:44.913698 (+ 5050us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:44.913717 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:44.914057 (+ 340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:44.914782 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:44.914786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:44.915291 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:44.915589 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.915601 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.916918 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.916923 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.918453 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.918469 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.919692 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.919699 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.919959 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.920512 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:44.920535 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:44.924872 (+ 4337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:44.928926 (+ 4054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.928930 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.928934 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.929666 (+ 732us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.930102 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.930106 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.930110 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.930319 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.931094 (+ 775us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:44.931102 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:44.931536 (+ 434us) client_negotiation.cc:769] Sending connection context
0811 06:49:44.932858 (+ 1322us) client_negotiation.cc:240] Negotiation successful
0811 06:49:44.933368 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4924,"mutex_wait_us":215,"spinlock_wait_cycles":2944,"thread_start_us":4522,"threads_started":1}
I20260811 06:49:44.933959 24715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.895640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36287 (local address 127.12.145.1:52141)
0811 06:49:44.906106 (+ 10466us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:44.906153 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:44.910770 (+ 4617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:44.912094 (+ 1324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:44.912100 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:44.913215 (+ 1115us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:44.914349 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.914362 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.915907 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.915913 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.918097 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.918112 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.919283 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.919290 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.919624 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.920458 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:44.920490 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:44.925085 (+ 4595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:44.928739 (+ 3654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.928746 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.928764 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.929607 (+ 843us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.930045 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.930049 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.930052 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.930318 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.931543 (+ 1225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:44.931547 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:44.931718 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 06:49:44.932815 (+ 1097us) client_negotiation.cc:240] Negotiation successful
0811 06:49:44.933216 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10152,"mutex_wait_us":115,"spinlock_wait_cycles":36224,"thread_start_us":12355,"threads_started":1}
I20260811 06:49:44.934619 24709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.894927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:57031 (local address 127.12.145.61:39497)
0811 06:49:44.898408 (+ 3481us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:44.898415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:44.909600 (+ 11185us) server_negotiation.cc:407] Connection header received
0811 06:49:44.911247 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:44.911253 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:44.911339 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:44.911451 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:44.914543 (+ 3092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.915643 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.918855 (+ 3212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.919438 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.919564 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.925150 (+ 5586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:44.925156 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:44.925160 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:44.925200 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:44.928570 (+ 3370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.929745 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.929751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.929754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.929905 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:44.930447 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:44.930452 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:44.930455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:44.931304 (+ 849us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:44.931472 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:44.934004 (+ 2532us) server_negotiation.cc:299] Negotiation successful
0811 06:49:44.934254 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3347,"thread_start_us":3219,"threads_started":1}
I20260811 06:49:44.934919 24711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:44.896624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39497 (local address 127.12.145.1:57031)
0811 06:49:44.908404 (+ 11780us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:44.908423 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:44.910788 (+ 2365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:44.911930 (+ 1142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:44.911944 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:44.913837 (+ 1893us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:44.914335 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.914361 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.915816 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.915821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.918680 (+ 2859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:44.918694 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:44.919863 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:44.919870 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:44.920027 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:44.920659 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:44.920678 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:44.924871 (+ 4193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:44.928736 (+ 3865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.928746 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.928765 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.929626 (+ 861us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.930035 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:44.930040 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:44.930043 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:44.930300 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:44.931424 (+ 1124us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:44.931429 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:44.931716 (+ 287us) client_negotiation.cc:769] Sending connection context
0811 06:49:44.931893 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 06:49:44.932435 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11600,"mutex_wait_us":38,"spinlock_wait_cycles":37760,"thread_start_us":9056,"threads_started":1}
I20260811 06:49:44.936110 24699 heartbeater.cc:347] Connected to a master server at 127.12.145.62:38107
I20260811 06:49:44.936160 24702 heartbeater.cc:347] Connected to a master server at 127.12.145.61:39497
I20260811 06:49:44.936208 24697 heartbeater.cc:347] Connected to a master server at 127.12.145.60:36287
I20260811 06:49:44.936535 24699 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:44.936539 24702 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:44.936540 24697 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:44.937649 24699 heartbeater.cc:511] Master 127.12.145.62:38107 requested a full tablet report, sending...
I20260811 06:49:44.937681 24697 heartbeater.cc:511] Master 127.12.145.60:36287 requested a full tablet report, sending...
I20260811 06:49:44.938021 24702 heartbeater.cc:511] Master 127.12.145.61:39497 requested a full tablet report, sending...
I20260811 06:49:44.940291 24267 ts_manager.cc:194] Registered new tserver with Master: 7661e41354ed4534afc935a0bf9c6249 (127.12.145.1:37049)
I20260811 06:49:44.941406 23241 ts_manager.cc:194] Re-registered known tserver with Master: 7661e41354ed4534afc935a0bf9c6249 (127.12.145.1:37049)
I20260811 06:49:44.942657 23241 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:45895
I20260811 06:49:44.944273 24396 ts_manager.cc:194] Registered new tserver with Master: 7661e41354ed4534afc935a0bf9c6249 (127.12.145.1:37049)
I20260811 06:49:45.027272 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 23567
I20260811 06:49:45.056043 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:42157
--local_ip_for_outbound_sockets=127.12.145.2
--tserver_master_addrs=127.12.145.62:38107
--webserver_port=40875
--webserver_interface=127.12.145.2
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab
--principal=oryx/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.145.62:38107,127.12.145.61:39497
--tserver_master_addrs=127.12.145.62:38107,127.12.145.61:39497,127.12.145.60:36287 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:49:45.260056 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:45.260185 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260811 06:49:45.379933 24720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:45.380219 24720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:45.380359 24720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:45.387780 24720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:45.387898 24720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:45.388042 24720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:49:45.397473 24720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab
--principal=oryx/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:42157
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=40875
--tserver_master_addrs=127.12.145.62:38107,127.12.145.61:39497,127.12.145.60:36287
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:45.398792 24720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:45.400136 24720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:45.413386 24730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:45.413355 24735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:45.413841 24729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:45.414400 24720 server_base.cc:1034] running on GCE node
I20260811 06:49:45.415043 24720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:45.415974 24720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:45.417179 24720 hybrid_clock.cc:648] HybridClock initialized: now 1786430985417126 us; error 62 us; skew 500 ppm
I20260811 06:49:45.417490 24720 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:45 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430985, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:45.420567 24720 init.cc:377] Logged in from keytab as oryx/127.12.145.2@KRBTEST.COM (short username oryx)
I20260811 06:49:45.421950 24720 webserver.cc:460] Webserver started at http://127.12.145.2:40875/ using document root <none> and password file <none>
I20260811 06:49:45.422595 24720 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:45.422709 24720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:45.428171 24720 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260811 06:49:45.430896 24744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:45.432337 24720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:49:45.432494 24720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92"
format_stamp: "Formatted at 2026-08-11 06:49:42 on dist-test-slave-7lbf"
server_key: "aa74b0236dd876ecd4d79a38219d16f6"
server_key_iv: "8e39942ecac51a196d346655ecd7e32c"
server_key_version: "encryptionkey@0"
I20260811 06:49:45.433488 24720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:45.446056 24720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:45.449891 24720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:45.450158 24720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:45.451067 24720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:45.452445 24720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:45.452533 24720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:45.452633 24720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:45.452708 24720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:45.482364 24720 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:42157
I20260811 06:49:45.482456 24923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:42157 every 8 connection(s)
I20260811 06:49:45.483794 24720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:49:45.488430 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 24720
I20260811 06:49:45.488725 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 23778
Aug 11 06:49:45 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.3@KRBTEST.COM
Aug 11 06:49:45 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430985, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.61@KRBTEST.COM
Aug 11 06:49:45 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430985, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.60@KRBTEST.COM
Aug 11 06:49:45 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430985, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:49:45.526139 24938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:45.489790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34522 (local address 127.12.145.3:45279)
0811 06:49:45.497302 (+ 7512us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:45.497311 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:45.503133 (+ 5822us) server_negotiation.cc:407] Connection header received
0811 06:49:45.503224 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:45.503233 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:45.503513 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:45.503684 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:45.506144 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.507860 (+ 1716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.509924 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.510832 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.510930 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:45.517386 (+ 6456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:45.517402 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:45.517417 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:45.517485 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:45.522021 (+ 4536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:45.522799 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:45.522809 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:45.522812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:45.522982 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:45.523463 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:45.523469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:45.523472 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:45.523923 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:45.524244 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:45.525446 (+ 1202us) server_negotiation.cc:299] Negotiation successful
0811 06:49:45.525722 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7332,"thread_start_us":7194,"threads_started":1}
I20260811 06:49:45.527623 23997 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:45.533535 24933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:45.486615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:37305 (local address 127.12.145.60:36287)
0811 06:49:45.501859 (+ 15244us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:45.501865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:45.511304 (+ 9439us) server_negotiation.cc:407] Connection header received
0811 06:49:45.512969 (+ 1665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:45.512975 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:45.513066 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:45.513361 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:45.516447 (+ 3086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.517213 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.519715 (+ 2502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.520354 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.520475 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:45.526312 (+ 5837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:45.526319 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:45.526324 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:45.526375 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:45.529873 (+ 3498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:45.530980 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:45.530985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:45.530988 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:45.531138 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:45.531549 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:45.531555 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:45.531558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:45.531823 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:45.531950 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:45.532960 (+ 1010us) server_negotiation.cc:299] Negotiation successful
0811 06:49:45.533175 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15113,"thread_start_us":15021,"threads_started":1}
I20260811 06:49:45.533911 24934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:45.486615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:55289 (local address 127.12.145.61:39497)
0811 06:49:45.502261 (+ 15646us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:45.502267 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:45.503866 (+ 1599us) server_negotiation.cc:407] Connection header received
0811 06:49:45.512982 (+ 9116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:45.512989 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:45.513075 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:45.513164 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:45.516609 (+ 3445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.517667 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.519751 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.520187 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.520267 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:45.526324 (+ 6057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:45.526330 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:45.526334 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:45.526375 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:45.530066 (+ 3691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:45.531010 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:45.531017 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:45.531021 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:45.531179 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:45.532282 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:45.532287 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:45.532290 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:45.532642 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:45.532777 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:45.533227 (+ 450us) server_negotiation.cc:299] Negotiation successful
0811 06:49:45.533462 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15511,"thread_start_us":15651,"threads_started":1}
I20260811 06:49:45.534539 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:45.487241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36287 (local address 127.12.145.2:37305)
0811 06:49:45.511172 (+ 23931us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:45.511188 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:45.512623 (+ 1435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:45.513715 (+ 1092us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:45.513727 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:45.514912 (+ 1185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:45.516227 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:45.516256 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.517355 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.517361 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:45.519573 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:45.519591 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.520590 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.520597 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:45.521021 (+ 424us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:45.523279 (+ 2258us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:45.523302 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:45.526102 (+ 2800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:45.530038 (+ 3936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:45.530048 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:45.530065 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:45.530809 (+ 744us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:45.531241 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:45.531246 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:45.531250 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:45.531436 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:45.531948 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:45.531956 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:45.532320 (+ 364us) client_negotiation.cc:769] Sending connection context
0811 06:49:45.532623 (+ 303us) client_negotiation.cc:240] Negotiation successful
0811 06:49:45.533199 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23776,"mutex_wait_us":258,"spinlock_wait_cycles":68736,"thread_start_us":15675,"threads_started":1}
I20260811 06:49:45.535151 24936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:45.487241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39497 (local address 127.12.145.2:55289)
0811 06:49:45.503511 (+ 16270us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:45.503578 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:45.512610 (+ 9032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:45.513716 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:45.513729 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:45.514910 (+ 1181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:45.516229 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:45.516255 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.517850 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.517855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:45.519573 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:45.519592 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.520590 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.520597 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:45.521016 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:45.521876 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:45.521907 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:45.525373 (+ 3466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:45.530236 (+ 4863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:45.530242 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:45.530246 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:45.530862 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:45.531980 (+ 1118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:45.531985 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:45.531989 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:45.532152 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:45.532743 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:45.532748 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:45.532933 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 06:49:45.534330 (+ 1397us) client_negotiation.cc:240] Negotiation successful
0811 06:49:45.534687 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15938,"mutex_wait_us":315,"spinlock_wait_cycles":16384,"thread_start_us":24729,"threads_started":1}
I20260811 06:49:45.535989 24925 heartbeater.cc:347] Connected to a master server at 127.12.145.60:36287
I20260811 06:49:45.536350 24925 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:45.536796 24930 heartbeater.cc:347] Connected to a master server at 127.12.145.61:39497
I20260811 06:49:45.536939 24930 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:45.537281 24925 heartbeater.cc:511] Master 127.12.145.60:36287 requested a full tablet report, sending...
I20260811 06:49:45.537462 24930 heartbeater.cc:511] Master 127.12.145.61:39497 requested a full tablet report, sending...
I20260811 06:49:45.537928 24941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:45.504533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:56849 (local address 127.12.145.62:38107)
0811 06:49:45.514341 (+ 9808us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:45.514346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:45.514366 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:49:45.514428 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:45.514433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:45.514515 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:45.514643 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:45.517405 (+ 2762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.518565 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.521614 (+ 3049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.522274 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.522420 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:45.527211 (+ 4791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:45.527216 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:45.527221 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:45.527264 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:45.531004 (+ 3740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:45.535120 (+ 4116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:45.535126 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:45.535129 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:45.535282 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:45.535891 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:45.535896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:45.535900 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:45.536260 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:45.536602 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:45.537312 (+ 710us) server_negotiation.cc:299] Negotiation successful
0811 06:49:45.537565 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9689,"thread_start_us":9587,"threads_started":1}
I20260811 06:49:45.537959 24935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:45.504441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:56849)
0811 06:49:45.512609 (+ 8168us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:45.512627 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:45.512923 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:45.514830 (+ 1907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:45.514834 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:45.515505 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:45.516390 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:45.516402 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.519297 (+ 2895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.519302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:45.520953 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:45.520969 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:45.522496 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:45.522504 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:45.522711 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:45.523333 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:45.523361 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:45.526549 (+ 3188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:45.531317 (+ 4768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:45.531322 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:45.531327 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:45.531844 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:45.535553 (+ 3709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:45.535559 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:45.535563 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:45.535764 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:45.536797 (+ 1033us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:45.536801 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:45.536956 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 06:49:45.537205 (+ 249us) client_negotiation.cc:240] Negotiation successful
0811 06:49:45.537499 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8045,"mutex_wait_us":345,"spinlock_wait_cycles":2816,"thread_start_us":6409,"threads_started":1}
I20260811 06:49:45.539608 24396 ts_manager.cc:194] Registered new tserver with Master: 6e217cb726ad4e1e8ebe28f38ddb9c92 (127.12.145.2:42157)
I20260811 06:49:45.539608 24267 ts_manager.cc:194] Registered new tserver with Master: 6e217cb726ad4e1e8ebe28f38ddb9c92 (127.12.145.2:42157)
I20260811 06:49:45.540303 24927 heartbeater.cc:347] Connected to a master server at 127.12.145.62:38107
I20260811 06:49:45.540441 24927 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:45.540896 24927 heartbeater.cc:511] Master 127.12.145.62:38107 requested a full tablet report, sending...
I20260811 06:49:45.541937 23241 ts_manager.cc:194] Re-registered known tserver with Master: 6e217cb726ad4e1e8ebe28f38ddb9c92 (127.12.145.2:42157)
I20260811 06:49:45.542889 23241 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:56849
I20260811 06:49:45.620831 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 23778
I20260811 06:49:45.643771 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:45279
--local_ip_for_outbound_sockets=127.12.145.3
--tserver_master_addrs=127.12.145.62:38107
--webserver_port=38483
--webserver_interface=127.12.145.3
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab
--principal=oryx/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.145.62:38107,127.12.145.61:39497
--tserver_master_addrs=127.12.145.62:38107,127.12.145.61:39497,127.12.145.60:36287 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:49:45.944813 24699 heartbeater.cc:503] Master 127.12.145.62:38107 was elected leader, sending a full tablet report...
W20260811 06:49:45.972044 24943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:49:45.972306 24943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:49:45.972409 24943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:49:45.979530 24943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:49:45.979636 24943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:49:45.979754 24943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:49:45.989241 24943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab
--principal=oryx/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:45279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=38483
--tserver_master_addrs=127.12.145.62:38107,127.12.145.61:39497,127.12.145.60:36287
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:49:45.990489 24943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:49:45.992017 24943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:49:46.004999 24954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:46.005065 24962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:49:46.005041 24960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:49:46.006073 24943 server_base.cc:1034] running on GCE node
I20260811 06:49:46.006654 24943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:49:46.007501 24943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:49:46.008733 24943 hybrid_clock.cc:648] HybridClock initialized: now 1786430986008666 us; error 43 us; skew 500 ppm
I20260811 06:49:46.009091 24943 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:49:46 dist-test-slave-7lbf krb5kdc[23163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430986, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:49:46.012303 24943 init.cc:377] Logged in from keytab as oryx/127.12.145.3@KRBTEST.COM (short username oryx)
I20260811 06:49:46.013811 24943 webserver.cc:460] Webserver started at http://127.12.145.3:38483/ using document root <none> and password file <none>
I20260811 06:49:46.014467 24943 fs_manager.cc:359] Metadata directory not provided
I20260811 06:49:46.014598 24943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:49:46.019932 24943 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260811 06:49:46.022619 24974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:46.023852 24943 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:49:46.023994 24943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "4a5c3b3170b949d2984b60301f7a337d"
format_stamp: "Formatted at 2026-08-11 06:49:42 on dist-test-slave-7lbf"
server_key: "ab71b1b4a09fad617956e01295ad2d98"
server_key_iv: "468e05748693a0458cb71cb203c0fb38"
server_key_version: "encryptionkey@0"
I20260811 06:49:46.024966 24943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:49:46.060189 24943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:49:46.064393 24943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:49:46.064662 24943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:49:46.065641 24943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:49:46.067175 24943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:49:46.067265 24943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:46.067384 24943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:49:46.067458 24943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:49:46.097378 24943 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:45279
I20260811 06:49:46.097433 25171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:45279 every 8 connection(s)
I20260811 06:49:46.098834 24943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:49:46.107450 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 24943
Aug 11 06:49:46 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430986, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
Aug 11 06:49:46 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430986, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.60@KRBTEST.COM
Aug 11 06:49:46 dist-test-slave-7lbf krb5kdc[23163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786430986, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.61@KRBTEST.COM
I20260811 06:49:46.140686 25178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.101668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:48701 (local address 127.12.145.60:36287)
0811 06:49:46.114454 (+ 12786us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.114461 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.114483 (+ 22us) server_negotiation.cc:407] Connection header received
0811 06:49:46.114552 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.114558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.114650 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.114781 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:46.117013 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.118230 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.121705 (+ 3475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.122376 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.122491 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.131155 (+ 8664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:46.131163 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:46.131168 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:46.131218 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:46.135028 (+ 3810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.137102 (+ 2074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.137109 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.137114 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.137290 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.138090 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.138096 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.138100 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.138642 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:46.138785 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.140086 (+ 1301us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.140298 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12655,"thread_start_us":12537,"threads_started":1}
I20260811 06:49:46.141170 25188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.110323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:43271 (local address 127.12.145.62:38107)
0811 06:49:46.113978 (+ 3655us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.113985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.114007 (+ 22us) server_negotiation.cc:407] Connection header received
0811 06:49:46.114080 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.114086 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.114189 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.116459 (+ 2270us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:46.117238 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.118751 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.120666 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.121268 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.121396 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.131267 (+ 9871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:46.131274 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:46.131278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:46.131341 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:46.134973 (+ 3632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.138499 (+ 3526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.138505 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.138509 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.138666 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.139313 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.139318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.139321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.139803 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:46.139929 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.140584 (+ 655us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.140792 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3522,"thread_start_us":3399,"threads_started":1}
I20260811 06:49:46.141990 25187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.110176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:43271)
0811 06:49:46.110681 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:46.110695 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:46.110777 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:46.114668 (+ 3891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:46.114681 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:46.116000 (+ 1319us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:46.117087 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.117097 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.118943 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.118948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.120520 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.120542 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.125172 (+ 4630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.125179 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.125372 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.126058 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:46.126083 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:46.131064 (+ 4981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:46.137758 (+ 6694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:46.137764 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:46.137773 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:46.138386 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:46.139015 (+ 629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:46.139021 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:46.139025 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:46.139203 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:46.140167 (+ 964us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:46.140172 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:46.140322 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 06:49:46.140475 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 06:49:46.140731 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":485,"thread_start_us":264,"threads_started":1}
I20260811 06:49:46.143496 25174 heartbeater.cc:347] Connected to a master server at 127.12.145.62:38107
I20260811 06:49:46.143868 25174 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:46.144302 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.102357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36287 (local address 127.12.145.3:48701)
0811 06:49:46.109972 (+ 7615us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:46.109990 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:46.110105 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:46.114782 (+ 4677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:46.114786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:46.115850 (+ 1064us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:46.116813 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.116838 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.118442 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.118447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.121153 (+ 2706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.121171 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.123421 (+ 2250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.123429 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.123735 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.125162 (+ 1427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:46.125201 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:46.130556 (+ 5355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:46.135236 (+ 4680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:46.135246 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:46.135266 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:46.136465 (+ 1199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:46.137609 (+ 1144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:46.137614 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:46.137618 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:46.137928 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:46.139071 (+ 1143us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:46.139081 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:46.139580 (+ 499us) client_negotiation.cc:769] Sending connection context
0811 06:49:46.139978 (+ 398us) client_negotiation.cc:240] Negotiation successful
0811 06:49:46.140500 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7458,"mutex_wait_us":308,"spinlock_wait_cycles":34048,"thread_start_us":6987,"threads_started":1}
I20260811 06:49:46.144881 25174 heartbeater.cc:511] Master 127.12.145.62:38107 requested a full tablet report, sending...
I20260811 06:49:46.145551 25172 heartbeater.cc:347] Connected to a master server at 127.12.145.60:36287
I20260811 06:49:46.145696 25172 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:46.146165 25172 heartbeater.cc:511] Master 127.12.145.60:36287 requested a full tablet report, sending...
I20260811 06:49:46.146791 23241 ts_manager.cc:194] Re-registered known tserver with Master: 4a5c3b3170b949d2984b60301f7a337d (127.12.145.3:45279)
I20260811 06:49:46.147389 25181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.102357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39497 (local address 127.12.145.3:46317)
0811 06:49:46.103216 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:46.103269 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:46.105919 (+ 2650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:46.118002 (+ 12083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:46.118006 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:46.118437 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:49:46.118787 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.118810 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.121990 (+ 3180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.121996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.123568 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.123585 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.128311 (+ 4726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.128319 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.128520 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.130055 (+ 1535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:49:46.130080 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:49:46.133505 (+ 3425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:49:46.138546 (+ 5041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:46.138551 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:46.138554 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:46.139398 (+ 844us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:46.139834 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:49:46.139839 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:49:46.139842 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:49:46.140037 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:49:46.146253 (+ 6216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:49:46.146258 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:49:46.146440 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 06:49:46.146688 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 06:49:46.147030 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":47,"thread_start_us":385,"threads_started":1}
I20260811 06:49:46.147456 25180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.101797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:46317 (local address 127.12.145.61:39497)
0811 06:49:46.117672 (+ 15875us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.117678 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.117698 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:49:46.117756 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.117762 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.117857 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.117982 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:46.120707 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.121781 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.123755 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.124773 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.124909 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.133759 (+ 8850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:46.133765 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:46.133770 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:46.133824 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:46.137608 (+ 3784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.139527 (+ 1919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.139531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.139535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.139676 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.142586 (+ 2910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.142591 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.142594 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.145165 (+ 2571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:46.145316 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.146794 (+ 1478us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.147055 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15089,"thread_start_us":14972,"threads_started":1}
I20260811 06:49:46.147874 23241 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:43271
I20260811 06:49:46.149181 25175 heartbeater.cc:347] Connected to a master server at 127.12.145.61:39497
I20260811 06:49:46.149284 24396 ts_manager.cc:194] Registered new tserver with Master: 4a5c3b3170b949d2984b60301f7a337d (127.12.145.3:45279)
I20260811 06:49:46.149329 25175 heartbeater.cc:464] Registering TS with master...
I20260811 06:49:46.149845 25175 heartbeater.cc:511] Master 127.12.145.61:39497 requested a full tablet report, sending...
I20260811 06:49:46.151047 24267 ts_manager.cc:194] Registered new tserver with Master: 4a5c3b3170b949d2984b60301f7a337d (127.12.145.3:45279)
I20260811 06:49:46.160604 25188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.119872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35826 (local address 127.12.145.62:38107)
0811 06:49:46.141432 (+ 21560us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.141438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.141461 (+ 23us) server_negotiation.cc:407] Connection header received
0811 06:49:46.141507 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.141533 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.141612 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.141717 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:46.144098 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.145135 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.148064 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.148682 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.148813 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.152860 (+ 4047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:46.152864 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:46.152867 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:46.152896 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:46.156299 (+ 3403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.158370 (+ 2071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.158376 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.158380 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.158527 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.158891 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.158897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.158901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.159246 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:46.159481 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.159921 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.160257 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21441,"thread_start_us":21601,"threads_started":1}
I20260811 06:49:46.166002 25178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.143397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34936 (local address 127.12.145.60:36287)
0811 06:49:46.143552 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.143557 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.148332 (+ 4775us) server_negotiation.cc:407] Connection header received
0811 06:49:46.148386 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.148391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.148467 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.148577 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:46.151584 (+ 3007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.152230 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.153915 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.154357 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.154462 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.157459 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:46.157463 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:46.157466 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:46.157502 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:46.160837 (+ 3335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.162171 (+ 1334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.162176 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.162178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.162339 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.163097 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.163103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.163106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.163491 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:46.163747 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.165627 (+ 1880us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.165799 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:49:46.168658 25197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.119983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33294 (local address 127.12.145.61:39497)
0811 06:49:46.138868 (+ 18885us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.138876 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.142343 (+ 3467us) server_negotiation.cc:407] Connection header received
0811 06:49:46.142400 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.142404 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.142473 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.142574 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:46.153255 (+ 10681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.154434 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.156384 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.156836 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.156942 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.162286 (+ 5344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:46.162292 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:46.162296 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:46.162333 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:46.166124 (+ 3791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.166718 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.166723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.166727 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.166881 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.167183 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.167189 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.167192 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.167534 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:46.167762 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.167997 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.168276 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18754,"thread_start_us":18897,"threads_started":1}
I20260811 06:49:46.165675 23241 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35826:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:49:46.173789 23241 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:49:46.207348 25218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.189920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35084 (local address 127.12.145.2:42157)
0811 06:49:46.198163 (+ 8243us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.198171 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.198202 (+ 31us) server_negotiation.cc:407] Connection header received
0811 06:49:46.198358 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.198367 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.198731 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.200265 (+ 1534us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:46.200757 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.202270 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.204839 (+ 2569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.206265 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.206399 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.206612 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.206893 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.207070 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7872,"thread_start_us":7758,"threads_started":1}
I20260811 06:49:46.207346 25219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.189643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:42157 (local address 127.0.0.1:35084)
0811 06:49:46.190975 (+ 1332us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:46.190996 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:46.191123 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:46.200243 (+ 9120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:46.200248 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:46.200272 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:46.200557 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.200570 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.202429 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.202435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.204630 (+ 2195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.204645 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.206496 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.206502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.206672 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.206708 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 06:49:46.206812 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 06:49:46.206944 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1198,"mutex_wait_us":4,"thread_start_us":8061,"threads_started":1}
I20260811 06:49:46.209081 25220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.190765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34538 (local address 127.12.145.3:45279)
0811 06:49:46.194187 (+ 3422us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.194194 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.198104 (+ 3910us) server_negotiation.cc:407] Connection header received
0811 06:49:46.200757 (+ 2653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.200765 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.200995 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.201194 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:46.201813 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.203496 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.206020 (+ 2524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.207572 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.207660 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.207844 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.208540 (+ 696us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.208752 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3264,"thread_start_us":3094,"threads_started":1}
I20260811 06:49:46.209832 25222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.198036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:37049 (local address 127.0.0.1:48414)
0811 06:49:46.198638 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:46.198654 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:46.198772 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:46.201878 (+ 3106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:46.201882 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:46.201906 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:46.202231 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.202243 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.203951 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.203956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.206797 (+ 2841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.206811 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.209129 (+ 2318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.209136 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.209297 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.209327 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 06:49:46.209413 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 06:49:46.209563 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":322,"threads_started":1}
I20260811 06:49:46.209899 25213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.190322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:45279 (local address 127.0.0.1:34538)
0811 06:49:46.197947 (+ 7625us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:46.197966 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:46.200544 (+ 2578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:46.201196 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:46.201200 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:46.201226 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:46.201595 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.201609 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.203648 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.203653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.205827 (+ 2174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.205845 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.208023 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.208029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.208314 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.208357 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 06:49:46.209357 (+ 1000us) client_negotiation.cc:240] Negotiation successful
0811 06:49:46.209497 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7505,"mutex_wait_us":35,"thread_start_us":682,"threads_started":1}
I20260811 06:49:46.210412 25225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.198305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48414 (local address 127.12.145.1:37049)
0811 06:49:46.201083 (+ 2778us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.201089 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.201112 (+ 23us) server_negotiation.cc:407] Connection header received
0811 06:49:46.201200 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.201207 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.201425 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.201801 (+ 376us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:46.202425 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.203821 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.206981 (+ 3160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.208618 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.208753 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.208954 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.210068 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.210205 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2586,"thread_start_us":2474,"threads_started":1}
I20260811 06:49:46.211974 24822 tablet_service.cc:1467] Processing CreateTablet for tablet 5679095d7ea4462899ee94330fb74a6a (DEFAULT_TABLE table=test-table [id=595163f5a9dc410d8a5e9b73b6546809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:46.213483 24822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5679095d7ea4462899ee94330fb74a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:46.213562 25057 tablet_service.cc:1467] Processing CreateTablet for tablet 5679095d7ea4462899ee94330fb74a6a (DEFAULT_TABLE table=test-table [id=595163f5a9dc410d8a5e9b73b6546809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:46.213722 24592 tablet_service.cc:1467] Processing CreateTablet for tablet 5679095d7ea4462899ee94330fb74a6a (DEFAULT_TABLE table=test-table [id=595163f5a9dc410d8a5e9b73b6546809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:49:46.214761 25057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5679095d7ea4462899ee94330fb74a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:46.215008 24592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5679095d7ea4462899ee94330fb74a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:49:46.227613 25226 tablet_bootstrap.cc:492] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: Bootstrap starting.
I20260811 06:49:46.230660 25234 tablet_bootstrap.cc:492] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: Bootstrap starting.
I20260811 06:49:46.231313 25226 tablet_bootstrap.cc:654] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:46.232844 25226 log.cc:824] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:46.234440 25234 tablet_bootstrap.cc:654] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:46.234768 25232 tablet_bootstrap.cc:492] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: Bootstrap starting.
I20260811 06:49:46.235926 25234 log.cc:824] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:46.236207 25226 tablet_bootstrap.cc:492] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: No bootstrap required, opened a new log
I20260811 06:49:46.236558 25226 ts_tablet_manager.cc:1397] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260811 06:49:46.238492 25232 tablet_bootstrap.cc:654] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: Neither blocks nor log segments found. Creating new log.
I20260811 06:49:46.239259 25234 tablet_bootstrap.cc:492] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: No bootstrap required, opened a new log
I20260811 06:49:46.239535 25234 ts_tablet_manager.cc:1397] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260811 06:49:46.239743 25232 log.cc:824] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: Log is configured to *not* fsync() on all Append() calls
I20260811 06:49:46.242923 25232 tablet_bootstrap.cc:492] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: No bootstrap required, opened a new log
I20260811 06:49:46.243193 25232 ts_tablet_manager.cc:1397] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20260811 06:49:46.244729 25226 raft_consensus.cc:348] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 } } peers { permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 } } peers { permanent_uuid: "4a5c3b3170b949d2984b60301f7a337d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45279 } }
I20260811 06:49:46.245138 25226 raft_consensus.cc:374] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:46.245322 25226 raft_consensus.cc:729] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5c3b3170b949d2984b60301f7a337d, State: Initialized, Role: FOLLOWER
I20260811 06:49:46.246080 25226 consensus_queue.cc:260] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 } } peers { permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 } } peers { permanent_uuid: "4a5c3b3170b949d2984b60301f7a337d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45279 } }
I20260811 06:49:46.249791 25234 raft_consensus.cc:348] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 } } peers { permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 } } peers { permanent_uuid: "4a5c3b3170b949d2984b60301f7a337d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45279 } }
I20260811 06:49:46.250365 25234 raft_consensus.cc:374] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:46.250521 25234 raft_consensus.cc:729] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7661e41354ed4534afc935a0bf9c6249, State: Initialized, Role: FOLLOWER
I20260811 06:49:46.251003 25226 ts_tablet_manager.cc:1428] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260811 06:49:46.251327 25174 heartbeater.cc:503] Master 127.12.145.62:38107 was elected leader, sending a full tablet report...
I20260811 06:49:46.251391 25234 consensus_queue.cc:260] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 } } peers { permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 } } peers { permanent_uuid: "4a5c3b3170b949d2984b60301f7a337d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45279 } }
I20260811 06:49:46.254397 25232 raft_consensus.cc:348] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 } } peers { permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 } } peers { permanent_uuid: "4a5c3b3170b949d2984b60301f7a337d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45279 } }
I20260811 06:49:46.254928 25232 raft_consensus.cc:374] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:49:46.255069 25232 raft_consensus.cc:729] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e217cb726ad4e1e8ebe28f38ddb9c92, State: Initialized, Role: FOLLOWER
I20260811 06:49:46.255836 25232 consensus_queue.cc:260] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 } } peers { permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 } } peers { permanent_uuid: "4a5c3b3170b949d2984b60301f7a337d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45279 } }
I20260811 06:49:46.258077 25234 ts_tablet_manager.cc:1428] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: Time spent starting tablet: real 0.018s user 0.016s sys 0.004s
I20260811 06:49:46.258615 25232 ts_tablet_manager.cc:1428] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260811 06:49:46.259086 24927 heartbeater.cc:503] Master 127.12.145.62:38107 was elected leader, sending a full tablet report...
W20260811 06:49:46.262218 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:46.262356 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:46.283725 25244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:46.284006 25244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } peers { permanent_uuid: "446c9e60cef64b7eb97cfdc7245683fe" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } }
I20260811 06:49:46.284823 25244 leader_election.cc:288] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107), a3d34b77fc8a45a2b90990349f984422 (127.12.145.61:39497)
I20260811 06:49:46.285293 24282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "446c9e60cef64b7eb97cfdc7245683fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d34b77fc8a45a2b90990349f984422" is_pre_election: true
I20260811 06:49:46.285329 23255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "446c9e60cef64b7eb97cfdc7245683fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9648bd90acc94b9eb272c8cd354f5276" is_pre_election: true
I20260811 06:49:46.285998 24369 leader_election.cc:302] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446c9e60cef64b7eb97cfdc7245683fe; no voters: 9648bd90acc94b9eb272c8cd354f5276, a3d34b77fc8a45a2b90990349f984422
I20260811 06:49:46.286250 25244 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:49:46.351788 25176 tablet.cc:2369] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:49:46.366130 25239 raft_consensus.cc:482] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:46.366446 25239 raft_consensus.cc:504] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 } } peers { permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 } } peers { permanent_uuid: "4a5c3b3170b949d2984b60301f7a337d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45279 } }
I20260811 06:49:46.368141 25239 leader_election.cc:288] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e217cb726ad4e1e8ebe28f38ddb9c92 (127.12.145.2:42157), 7661e41354ed4534afc935a0bf9c6249 (127.12.145.1:37049)
I20260811 06:49:46.375046 25187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.368766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:37049 (local address 127.12.145.3:54807)
0811 06:49:46.368976 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:46.368992 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:46.369086 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:46.369746 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:46.369751 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:46.369778 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:46.369944 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.369954 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.371281 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.371287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.373099 (+ 1812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.373110 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.374288 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.374294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.374491 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.374517 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 06:49:46.374606 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 06:49:46.374750 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":21}
I20260811 06:49:46.375026 25225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.369197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:54807 (local address 127.12.145.1:37049)
0811 06:49:46.369412 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.369418 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.369436 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:49:46.369501 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.369507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.369613 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.369696 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:46.370088 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.371123 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.373291 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.374119 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.374276 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.374354 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.374651 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.374781 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 06:49:46.375305 25181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.368421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:42157 (local address 127.12.145.3:58715)
0811 06:49:46.368746 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:46.368767 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:49:46.368908 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:49:46.369344 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:49:46.369350 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:49:46.369390 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:49:46.369654 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.369667 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.370819 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.370825 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.372805 (+ 1980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:49:46.372821 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.374555 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.374562 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:49:46.374781 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.374814 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 06:49:46.374901 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 06:49:46.375039 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":38}
I20260811 06:49:46.375898 25218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.368550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:58715 (local address 127.12.145.2:42157)
0811 06:49:46.368746 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.368753 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.368940 (+ 187us) server_negotiation.cc:407] Connection header received
0811 06:49:46.369096 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.369103 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.369184 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.369275 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:49:46.369836 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.370692 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.372978 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.374234 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.374374 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.374444 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.375496 (+ 1052us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.375642 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 06:49:46.376284 24626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5679095d7ea4462899ee94330fb74a6a" candidate_uuid: "4a5c3b3170b949d2984b60301f7a337d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7661e41354ed4534afc935a0bf9c6249" is_pre_election: true
I20260811 06:49:46.376827 24626 raft_consensus.cc:2454] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5c3b3170b949d2984b60301f7a337d in term 0.
I20260811 06:49:46.376897 24857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5679095d7ea4462899ee94330fb74a6a" candidate_uuid: "4a5c3b3170b949d2984b60301f7a337d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" is_pre_election: true
I20260811 06:49:46.377432 24857 raft_consensus.cc:2454] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5c3b3170b949d2984b60301f7a337d in term 0.
I20260811 06:49:46.377538 24978 leader_election.cc:302] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5c3b3170b949d2984b60301f7a337d, 7661e41354ed4534afc935a0bf9c6249; no voters:
I20260811 06:49:46.377944 25239 raft_consensus.cc:2781] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:49:46.378088 25239 raft_consensus.cc:482] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:49:46.378191 25239 raft_consensus.cc:3037] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:46.380378 25239 raft_consensus.cc:504] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 } } peers { permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 } } peers { permanent_uuid: "4a5c3b3170b949d2984b60301f7a337d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45279 } }
I20260811 06:49:46.380926 25239 leader_election.cc:288] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [CANDIDATE]: Term 1 election: Requested vote from peers 6e217cb726ad4e1e8ebe28f38ddb9c92 (127.12.145.2:42157), 7661e41354ed4534afc935a0bf9c6249 (127.12.145.1:37049)
I20260811 06:49:46.381412 24857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5679095d7ea4462899ee94330fb74a6a" candidate_uuid: "4a5c3b3170b949d2984b60301f7a337d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92"
I20260811 06:49:46.381474 24626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5679095d7ea4462899ee94330fb74a6a" candidate_uuid: "4a5c3b3170b949d2984b60301f7a337d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7661e41354ed4534afc935a0bf9c6249"
I20260811 06:49:46.381628 24857 raft_consensus.cc:3037] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:46.381719 24626 raft_consensus.cc:3037] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:46.383888 24857 raft_consensus.cc:2454] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5c3b3170b949d2984b60301f7a337d in term 1.
I20260811 06:49:46.383932 24626 raft_consensus.cc:2454] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5c3b3170b949d2984b60301f7a337d in term 1.
I20260811 06:49:46.384259 24978 leader_election.cc:302] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5c3b3170b949d2984b60301f7a337d, 6e217cb726ad4e1e8ebe28f38ddb9c92; no voters:
I20260811 06:49:46.384591 25239 raft_consensus.cc:2781] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:49:46.385146 25239 raft_consensus.cc:686] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 1 LEADER]: Becoming Leader. State: Replica: 4a5c3b3170b949d2984b60301f7a337d, State: Running, Role: LEADER
I20260811 06:49:46.385705 25239 consensus_queue.cc:237] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 } } peers { permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 } } peers { permanent_uuid: "4a5c3b3170b949d2984b60301f7a337d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45279 } }
I20260811 06:49:46.390933 23241 catalog_manager.cc:5495] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a5c3b3170b949d2984b60301f7a337d (127.12.145.3). New cstate: current_term: 1 leader_uuid: "4a5c3b3170b949d2984b60301f7a337d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5c3b3170b949d2984b60301f7a337d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45279 } health_report { overall_health: HEALTHY } } }
W20260811 06:49:46.401590 24708 tablet.cc:2369] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:49:46.449306 25220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.443575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34542 (local address 127.12.145.3:45279)
0811 06:49:46.443781 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.443787 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.443808 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:49:46.443965 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.443969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.444050 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.444185 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:49:46.444582 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.445344 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.447114 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.447575 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.447687 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.448183 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:49:46.448733 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:49:46.448876 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.448958 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.449040 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 06:49:46.457840 24626 raft_consensus.cc:1261] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249 [term 1 FOLLOWER]: Refusing update from remote peer 4a5c3b3170b949d2984b60301f7a337d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:46.457840 24857 raft_consensus.cc:1261] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92 [term 1 FOLLOWER]: Refusing update from remote peer 4a5c3b3170b949d2984b60301f7a337d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:49:46.458869 25245 consensus_queue.cc:1035] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7661e41354ed4534afc935a0bf9c6249" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 37049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:46.459312 25239 consensus_queue.cc:1035] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e217cb726ad4e1e8ebe28f38ddb9c92" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 42157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:49:46.502243 23241 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:46.502600 23241 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:49:46.511750 23241 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9648bd90acc94b9eb272c8cd354f5276: Sending DeleteTablet for 3 replicas of tablet 5679095d7ea4462899ee94330fb74a6a
I20260811 06:49:46.513006 24822 tablet_service.cc:1514] Processing DeleteTablet for tablet 5679095d7ea4462899ee94330fb74a6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:46 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:35084
I20260811 06:49:46.514952 25270 tablet_replica.cc:330] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: stopping tablet replica
I20260811 06:49:46.515606 25270 raft_consensus.cc:2229] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:46.515663 24592 tablet_service.cc:1514] Processing DeleteTablet for tablet 5679095d7ea4462899ee94330fb74a6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:46 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:48414
I20260811 06:49:46.516235 25270 raft_consensus.cc:2258] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:46.518065 25271 tablet_replica.cc:330] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: stopping tablet replica
I20260811 06:49:46.518199 25057 tablet_service.cc:1514] Processing DeleteTablet for tablet 5679095d7ea4462899ee94330fb74a6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:49:46 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:34538
I20260811 06:49:46.518488 25271 raft_consensus.cc:2229] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:49:46.518989 25271 raft_consensus.cc:2258] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:46.519562 25270 ts_tablet_manager.cc:1905] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:46.521560 25271 ts_tablet_manager.cc:1905] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:46.528644 25271 ts_tablet_manager.cc:1918] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:49:46.528927 25271 log.cc:1196] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/5679095d7ea4462899ee94330fb74a6a
I20260811 06:49:46.529687 25271 ts_tablet_manager.cc:1939] T 5679095d7ea4462899ee94330fb74a6a P 7661e41354ed4534afc935a0bf9c6249: Deleting consensus metadata
I20260811 06:49:46.531756 23214 catalog_manager.cc:4841] TS 7661e41354ed4534afc935a0bf9c6249 (127.12.145.1:37049): tablet 5679095d7ea4462899ee94330fb74a6a (table test-table [id=595163f5a9dc410d8a5e9b73b6546809]) successfully deleted
I20260811 06:49:46.532919 25270 ts_tablet_manager.cc:1918] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:49:46.533169 25270 log.cc:1196] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/5679095d7ea4462899ee94330fb74a6a
I20260811 06:49:46.533773 25272 tablet_replica.cc:330] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: stopping tablet replica
I20260811 06:49:46.533846 25270 ts_tablet_manager.cc:1939] T 5679095d7ea4462899ee94330fb74a6a P 6e217cb726ad4e1e8ebe28f38ddb9c92: Deleting consensus metadata
I20260811 06:49:46.534310 25272 raft_consensus.cc:2229] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:49:46.535043 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 23185
I20260811 06:49:46.535002 25272 raft_consensus.cc:2258] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:49:46.536446 23214 catalog_manager.cc:4841] TS 6e217cb726ad4e1e8ebe28f38ddb9c92 (127.12.145.2:42157): tablet 5679095d7ea4462899ee94330fb74a6a (table test-table [id=595163f5a9dc410d8a5e9b73b6546809]) successfully deleted
I20260811 06:49:46.536667 23290 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:49:46.546670 25272 ts_tablet_manager.cc:1905] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:49:46.553826 25197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.520817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33296 (local address 127.12.145.61:39497)
0811 06:49:46.521614 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.521621 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.532376 (+ 10755us) server_negotiation.cc:407] Connection header received
0811 06:49:46.533763 (+ 1387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.533770 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.533864 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.533990 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:46.538129 (+ 4139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.539373 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.541497 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.542233 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.542347 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.546160 (+ 3813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:46.546168 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:46.546174 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:46.546221 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:46.550077 (+ 3856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.551088 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.551094 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.551098 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.551256 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.551740 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.551745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.551749 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.552160 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:46.552406 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.553081 (+ 675us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.553347 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628}
I20260811 06:49:46.554693 25272 ts_tablet_manager.cc:1918] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:49:46.554951 25272 log.cc:1196] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/5679095d7ea4462899ee94330fb74a6a
I20260811 06:49:46.555584 25272 ts_tablet_manager.cc:1939] T 5679095d7ea4462899ee94330fb74a6a P 4a5c3b3170b949d2984b60301f7a337d: Deleting consensus metadata
I20260811 06:49:46.685950 23212 catalog_manager.cc:4841] TS 4a5c3b3170b949d2984b60301f7a337d (127.12.145.3:45279): tablet 5679095d7ea4462899ee94330fb74a6a (table test-table [id=595163f5a9dc410d8a5e9b73b6546809]) successfully deleted
I20260811 06:49:46.686661 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 23185
I20260811 06:49:46.734230 25197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.717340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33302 (local address 127.12.145.61:39497)
0811 06:49:46.717560 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.717567 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.718513 (+ 946us) server_negotiation.cc:407] Connection header received
0811 06:49:46.718778 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.718784 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.718865 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.718931 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:46.720956 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.722025 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.724275 (+ 2250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.724889 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.724983 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.728168 (+ 3185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:46.728174 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:46.728179 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:46.728229 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:46.731468 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.732181 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.732187 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.732191 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.732317 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.732694 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.732700 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.732703 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.732990 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:46.733209 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.733727 (+ 518us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.733970 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:49:46.739805 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:46.718305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34946 (local address 127.12.145.60:36287)
0811 06:49:46.724575 (+ 6270us) server_negotiation.cc:206] Beginning negotiation
0811 06:49:46.724581 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:49:46.725345 (+ 764us) server_negotiation.cc:407] Connection header received
0811 06:49:46.725546 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:49:46.725552 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:49:46.725637 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:49:46.725753 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:49:46.727814 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.728799 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.730501 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:49:46.731123 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:49:46.731258 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:49:46.734522 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:49:46.734528 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:49:46.734532 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:49:46.734570 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:49:46.737296 (+ 2726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.738082 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.738086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.738089 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.738210 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:49:46.738609 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:49:46.738612 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:49:46.738614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:49:46.738891 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:49:46.739095 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 06:49:46.739391 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 06:49:46.739551 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6139,"thread_start_us":6224,"threads_started":1}
W20260811 06:49:47.263839 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:47.264011 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:47.478335 25285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:47.477406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:42759)
0811 06:49:47.477909 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:47.478067 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":249,"threads_started":1}
W20260811 06:49:47.478891 25174 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:38107 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:47.488903 25287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:47.488186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:54759)
0811 06:49:47.488629 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:47.488742 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":218,"threads_started":1}
W20260811 06:49:47.489292 24927 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:38107 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:47.493155 25288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:47.492347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:45265)
0811 06:49:47.492802 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:47.492947 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":232,"threads_started":1}
W20260811 06:49:47.493799 24699 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:38107 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:48.014691 25289 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9648bd90acc94b9eb272c8cd354f5276)
I20260811 06:49:48.014926 25289 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } }
I20260811 06:49:48.015571 25289 leader_election.cc:288] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107)
I20260811 06:49:48.016732 25290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:48.015825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:41812)
0811 06:49:48.016350 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:48.016497 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":281,"threads_started":1}
W20260811 06:49:48.016983 24239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:48.018667 25290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:48.018339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:41822)
0811 06:49:48.018486 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:48.018556 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 06:49:48.018826 24239 leader_election.cc:334] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:48.018970 24239 leader_election.cc:302] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a3d34b77fc8a45a2b90990349f984422; no voters: 9648bd90acc94b9eb272c8cd354f5276
I20260811 06:49:48.019214 25289 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 06:49:48.265247 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:48.265384 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:48.480511 25294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:48.479651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:49261)
0811 06:49:48.480146 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:48.480254 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":258,"threads_started":1}
I20260811 06:49:48.490624 25295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:48.489946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:48751)
0811 06:49:48.490363 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:48.490444 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":217,"threads_started":1}
I20260811 06:49:48.495468 25296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:48.494496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:58329)
0811 06:49:48.495143 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:48.495244 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":444,"threads_started":1}
I20260811 06:49:49.258760 25299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:49.257868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:41974)
0811 06:49:49.258415 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:49.258540 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":253,"threads_started":1}
I20260811 06:49:49.259055 24207 master_runner.cc:186] Error getting master registration for 127.12.145.62:38107: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111),
I20260811 06:49:49.264551 24207 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 06:49:49.266446 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:49.266566 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:49.383181 25302 raft_consensus.cc:482] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:49.383497 25302 raft_consensus.cc:504] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } peers { permanent_uuid: "446c9e60cef64b7eb97cfdc7245683fe" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } }
I20260811 06:49:49.384178 25302 leader_election.cc:288] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107), a3d34b77fc8a45a2b90990349f984422 (127.12.145.61:39497)
I20260811 06:49:49.384696 25299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:49.384282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42004)
0811 06:49:49.384453 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:49.384567 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 06:49:49.384709 24282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "446c9e60cef64b7eb97cfdc7245683fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d34b77fc8a45a2b90990349f984422" is_pre_election: true
I20260811 06:49:49.384964 24282 raft_consensus.cc:1799] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Handling vote request from an unknown peer 446c9e60cef64b7eb97cfdc7245683fe
W20260811 06:49:49.384919 24370 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:49.385200 24282 raft_consensus.cc:2396] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446c9e60cef64b7eb97cfdc7245683fe for term 1 because replica has last-logged OpId of term: 1 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260811 06:49:49.386459 25299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:49.386095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42010)
0811 06:49:49.386243 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:49.386321 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 06:49:49.386619 24370 leader_election.cc:334] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:49.386773 24370 leader_election.cc:302] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446c9e60cef64b7eb97cfdc7245683fe; no voters: 9648bd90acc94b9eb272c8cd354f5276, a3d34b77fc8a45a2b90990349f984422
I20260811 06:49:49.387009 25302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:49:49.389098 25302 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:49:49.482262 25305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:49.481435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:39725)
0811 06:49:49.481953 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:49.482080 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":297,"threads_started":1}
I20260811 06:49:49.492138 25306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:49.491428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:45159)
0811 06:49:49.491897 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:49.491983 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":248,"threads_started":1}
I20260811 06:49:49.497735 25308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:49.496385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:45773)
0811 06:49:49.497386 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:49.497550 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":895,"thread_start_us":797,"threads_started":1}
I20260811 06:49:50.263669 25310 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9648bd90acc94b9eb272c8cd354f5276)
I20260811 06:49:50.263888 25310 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } }
I20260811 06:49:50.264403 25310 leader_election.cc:288] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107)
I20260811 06:49:50.265403 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:50.264640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42104)
0811 06:49:50.265118 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:50.265212 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":238,"threads_started":1}
I20260811 06:49:50.266573 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:50.266261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42112)
0811 06:49:50.266406 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:50.266472 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 06:49:50.266727 24239 leader_election.cc:334] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:50.266873 24239 leader_election.cc:302] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a3d34b77fc8a45a2b90990349f984422; no voters: 9648bd90acc94b9eb272c8cd354f5276
I20260811 06:49:50.267123 25310 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 06:49:50.267769 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:50.267879 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:50.484212 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:50.483395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:54213)
0811 06:49:50.483871 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:50.483996 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":229,"threads_started":1}
I20260811 06:49:50.493736 25316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:50.492958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:38483)
0811 06:49:50.493415 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:50.493502 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":236,"threads_started":1}
I20260811 06:49:50.499579 25320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:50.498644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:59415)
0811 06:49:50.499204 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:50.499319 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":372,"threads_started":1}
W20260811 06:49:51.269093 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:51.269233 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:51.486249 25321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:51.485410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:57893)
0811 06:49:51.485927 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:51.486054 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":265,"threads_started":1}
I20260811 06:49:51.495196 25323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:51.494564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:48231)
0811 06:49:51.494947 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:51.495032 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":190,"threads_started":1}
I20260811 06:49:51.501333 25324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:51.500530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:44231)
0811 06:49:51.501013 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:51.501126 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":271,"threads_started":1}
W20260811 06:49:52.270462 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:52.270622 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:52.488215 25326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:52.487219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:44877)
0811 06:49:52.487866 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:52.487996 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":389,"threads_started":1}
I20260811 06:49:52.496995 25327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:52.496114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:49627)
0811 06:49:52.496699 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:52.496788 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":360,"threads_started":1}
I20260811 06:49:52.503104 25328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:52.502286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:59573)
0811 06:49:52.502776 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:52.502885 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":233,"threads_started":1}
I20260811 06:49:52.715107 25332 raft_consensus.cc:482] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:52.715372 25332 raft_consensus.cc:504] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } peers { permanent_uuid: "446c9e60cef64b7eb97cfdc7245683fe" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } }
I20260811 06:49:52.716063 25332 leader_election.cc:288] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107), a3d34b77fc8a45a2b90990349f984422 (127.12.145.61:39497)
I20260811 06:49:52.716611 24282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "446c9e60cef64b7eb97cfdc7245683fe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d34b77fc8a45a2b90990349f984422" is_pre_election: true
I20260811 06:49:52.716840 24282 raft_consensus.cc:1799] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Handling vote request from an unknown peer 446c9e60cef64b7eb97cfdc7245683fe
I20260811 06:49:52.717033 24282 raft_consensus.cc:2396] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446c9e60cef64b7eb97cfdc7245683fe for term 2 because replica has last-logged OpId of term: 1 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260811 06:49:52.717200 25334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:52.716264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42352)
0811 06:49:52.716784 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:52.716942 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":245,"threads_started":1}
I20260811 06:49:52.718549 25334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:52.718220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42356)
0811 06:49:52.718353 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:52.718437 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 06:49:52.718724 24370 leader_election.cc:334] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:52.718899 24370 leader_election.cc:302] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446c9e60cef64b7eb97cfdc7245683fe; no voters: 9648bd90acc94b9eb272c8cd354f5276, a3d34b77fc8a45a2b90990349f984422
I20260811 06:49:52.719164 25332 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 06:49:53.271845 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:53.271999 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:53.438813 25338 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9648bd90acc94b9eb272c8cd354f5276)
I20260811 06:49:53.439083 25338 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } }
I20260811 06:49:53.439625 25338 leader_election.cc:288] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107)
I20260811 06:49:53.440608 25339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:53.439871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42432)
0811 06:49:53.440297 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:53.440420 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":195,"threads_started":1}
W20260811 06:49:53.440776 24239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260811 06:49:53.442544 25339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:53.442231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42444)
0811 06:49:53.442364 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:53.442435 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 06:49:53.442740 24239 leader_election.cc:334] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:53.442878 24239 leader_election.cc:302] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a3d34b77fc8a45a2b90990349f984422; no voters: 9648bd90acc94b9eb272c8cd354f5276
I20260811 06:49:53.443125 25338 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:49:53.490195 25342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:53.489223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:36387)
0811 06:49:53.489865 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:53.489984 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":357,"threads_started":1}
I20260811 06:49:53.498593 25343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:53.497799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:53315)
0811 06:49:53.498315 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:53.498412 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":233,"threads_started":1}
I20260811 06:49:53.505157 25344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:53.504276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:49181)
0811 06:49:53.504835 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:53.504946 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":251,"threads_started":1}
I20260811 06:49:54.266119 25346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:54.265327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42482)
0811 06:49:54.265838 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:54.265927 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":271,"threads_started":1}
I20260811 06:49:54.266361 24207 master_runner.cc:186] Error getting master registration for 127.12.145.62:38107: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111),
I20260811 06:49:54.266522 24207 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 06:49:54.273044 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:54.273155 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:54.492441 25347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:54.491551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:49567)
0811 06:49:54.492092 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:54.492204 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":269,"threads_started":1}
I20260811 06:49:54.500212 25348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:54.499411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:39491)
0811 06:49:54.499942 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:54.500041 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":296,"threads_started":1}
I20260811 06:49:54.506767 25349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:54.505990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:32773)
0811 06:49:54.506479 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:54.506585 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":225,"threads_started":1}
W20260811 06:49:55.274376 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:55.274518 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:55.494386 25350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:55.493476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:49473)
0811 06:49:55.494046 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:55.494176 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":242,"threads_started":1}
I20260811 06:49:55.501824 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:55.501074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:48739)
0811 06:49:55.501568 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:55.501657 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":241,"threads_started":1}
I20260811 06:49:55.508481 25352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:55.507716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:34191)
0811 06:49:55.508180 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:55.508279 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":240,"threads_started":1}
W20260811 06:49:56.275738 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:56.275868 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:56.496193 25353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:56.495377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:47923)
0811 06:49:56.495860 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:56.495969 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":248,"threads_started":1}
I20260811 06:49:56.503539 25357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:56.502717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:33579)
0811 06:49:56.503241 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:56.503344 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":287,"threads_started":1}
I20260811 06:49:56.510294 25359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:56.509415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:39373)
0811 06:49:56.509987 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:56.510099 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":370,"threads_started":1}
I20260811 06:49:56.574055 25361 raft_consensus.cc:482] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:49:56.574317 25361 raft_consensus.cc:504] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } peers { permanent_uuid: "446c9e60cef64b7eb97cfdc7245683fe" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } }
I20260811 06:49:56.575289 25361 leader_election.cc:288] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107), a3d34b77fc8a45a2b90990349f984422 (127.12.145.61:39497)
I20260811 06:49:56.576355 24282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "446c9e60cef64b7eb97cfdc7245683fe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d34b77fc8a45a2b90990349f984422" is_pre_election: true
I20260811 06:49:56.576499 25362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:56.575486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42634)
0811 06:49:56.576029 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:56.576195 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":321,"threads_started":1}
I20260811 06:49:56.576640 24282 raft_consensus.cc:1799] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Handling vote request from an unknown peer 446c9e60cef64b7eb97cfdc7245683fe
W20260811 06:49:56.576712 24370 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260811 06:49:56.576849 24282 raft_consensus.cc:2396] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446c9e60cef64b7eb97cfdc7245683fe for term 2 because replica has last-logged OpId of term: 1 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260811 06:49:56.578079 25362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:56.577709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:42640)
0811 06:49:56.577855 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:56.577941 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 06:49:56.578269 24370 leader_election.cc:334] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:56.578387 24370 leader_election.cc:302] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446c9e60cef64b7eb97cfdc7245683fe; no voters: 9648bd90acc94b9eb272c8cd354f5276, a3d34b77fc8a45a2b90990349f984422
I20260811 06:49:56.578704 25361 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 06:49:57.277155 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:57.277292 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:57.498131 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:57.497297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:60287)
0811 06:49:57.497848 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:57.497948 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":274,"threads_started":1}
I20260811 06:49:57.505138 25367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:57.504451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:34227)
0811 06:49:57.504885 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:57.504972 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":213,"threads_started":1}
I20260811 06:49:57.511951 25368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:57.511137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:39923)
0811 06:49:57.511626 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:57.511730 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":260,"threads_started":1}
W20260811 06:49:58.278540 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:58.278671 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:58.342931 25369 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9648bd90acc94b9eb272c8cd354f5276)
I20260811 06:49:58.343128 25369 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } }
I20260811 06:49:58.343724 25369 leader_election.cc:288] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107)
I20260811 06:49:58.344861 25371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:58.344018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:60940)
0811 06:49:58.344526 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:58.344656 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":246,"threads_started":1}
I20260811 06:49:58.346552 25371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:58.346199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:60948)
0811 06:49:58.346354 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:58.346436 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 06:49:58.346724 24239 leader_election.cc:334] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:49:58.346851 24239 leader_election.cc:302] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a3d34b77fc8a45a2b90990349f984422; no voters: 9648bd90acc94b9eb272c8cd354f5276
I20260811 06:49:58.347093 25369 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:49:58.500056 25373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:58.499192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:41821)
0811 06:49:58.499682 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:58.499808 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":285,"threads_started":1}
I20260811 06:49:58.506745 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:58.505993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:44497)
0811 06:49:58.506479 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:58.506568 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":248,"threads_started":1}
I20260811 06:49:58.513705 25377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:58.512889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:57389)
0811 06:49:58.513336 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:58.513450 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":216,"threads_started":1}
I20260811 06:49:59.268191 25380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:59.267311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:60988)
0811 06:49:59.267845 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:59.267952 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":257,"threads_started":1}
I20260811 06:49:59.268450 24207 master_runner.cc:186] Error getting master registration for 127.12.145.62:38107: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111),
I20260811 06:49:59.268654 24207 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 06:49:59.279865 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:49:59.279999 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:49:59.501978 25381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:59.501080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:35261)
0811 06:49:59.501623 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:59.501752 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":270,"threads_started":1}
I20260811 06:49:59.508424 25382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:59.507608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:60117)
0811 06:49:59.508128 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:59.508214 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":243,"threads_started":1}
I20260811 06:49:59.515576 25383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:49:59.514548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:40975)
0811 06:49:59.515247 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0811 06:49:59.515389 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":423,"threads_started":1}
W20260811 06:50:00.281211 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:00.281358 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:00.504201 25386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:00.503200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:45069)
0811 06:50:00.503719 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:00.503848 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":251,"threads_started":1}
I20260811 06:50:00.510205 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:00.509410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:54575)
0811 06:50:00.509924 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:00.510028 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":295,"threads_started":1}
I20260811 06:50:00.517607 25391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:00.516638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:38581)
0811 06:50:00.517219 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:00.517335 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":245,"threads_started":1}
W20260811 06:50:01.282618 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:01.282761 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:01.506074 25393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:01.505211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:39505)
0811 06:50:01.505783 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:01.505898 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":303,"threads_started":1}
I20260811 06:50:01.511793 25395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:01.511036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:54057)
0811 06:50:01.511557 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:01.511641 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":239,"threads_started":1}
I20260811 06:50:01.519299 25396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:01.518549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:58985)
0811 06:50:01.519006 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:01.519131 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":208,"threads_started":1}
W20260811 06:50:02.284045 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:02.284188 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:02.507918 25401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:02.507085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:44681)
0811 06:50:02.507602 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:02.507710 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":251,"threads_started":1}
I20260811 06:50:02.513588 25403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:02.512770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:38679)
0811 06:50:02.513265 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:02.513360 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":258,"threads_started":1}
I20260811 06:50:02.520967 25407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:02.520044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:49159)
0811 06:50:02.520577 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:02.520679 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":281,"threads_started":1}
I20260811 06:50:02.808094 25409 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9648bd90acc94b9eb272c8cd354f5276)
I20260811 06:50:02.808314 25409 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } }
I20260811 06:50:02.808959 25409 leader_election.cc:288] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107)
I20260811 06:50:02.810151 25410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:02.809221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:32932)
0811 06:50:02.809774 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:02.809912 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":296,"threads_started":1}
W20260811 06:50:02.810339 24239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260811 06:50:02.811602 25410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:02.811217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:32942)
0811 06:50:02.811424 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:02.811495 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260811 06:50:02.811753 24239 leader_election.cc:334] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:50:02.811873 24239 leader_election.cc:302] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a3d34b77fc8a45a2b90990349f984422; no voters: 9648bd90acc94b9eb272c8cd354f5276
I20260811 06:50:02.812093 25409 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 06:50:03.285315 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:03.285447 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:03.509699 25415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:03.508798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:48903)
0811 06:50:03.509304 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:03.509420 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":252,"threads_started":1}
I20260811 06:50:03.515240 25416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:03.514496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:53537)
0811 06:50:03.514951 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:03.515058 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":238,"threads_started":1}
I20260811 06:50:03.522607 25417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:03.521834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:41091)
0811 06:50:03.522331 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:03.522428 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":257,"threads_started":1}
I20260811 06:50:04.260262 25418 raft_consensus.cc:482] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:50:04.260492 25418 raft_consensus.cc:504] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } peers { permanent_uuid: "446c9e60cef64b7eb97cfdc7245683fe" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } }
I20260811 06:50:04.261296 25418 leader_election.cc:288] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107), a3d34b77fc8a45a2b90990349f984422 (127.12.145.61:39497)
I20260811 06:50:04.261916 24282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "446c9e60cef64b7eb97cfdc7245683fe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d34b77fc8a45a2b90990349f984422" is_pre_election: true
I20260811 06:50:04.262145 24282 raft_consensus.cc:1799] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Handling vote request from an unknown peer 446c9e60cef64b7eb97cfdc7245683fe
I20260811 06:50:04.262329 24282 raft_consensus.cc:2396] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446c9e60cef64b7eb97cfdc7245683fe for term 2 because replica has last-logged OpId of term: 1 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260811 06:50:04.262468 25419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:04.261562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:33012)
0811 06:50:04.262050 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:04.262208 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":262,"threads_started":1}
W20260811 06:50:04.262691 24370 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:50:04.263859 25419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:04.263549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:33024)
0811 06:50:04.263675 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:04.263744 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 06:50:04.264005 24370 leader_election.cc:334] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:50:04.264137 24370 leader_election.cc:302] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446c9e60cef64b7eb97cfdc7245683fe; no voters: 9648bd90acc94b9eb272c8cd354f5276, a3d34b77fc8a45a2b90990349f984422
I20260811 06:50:04.264395 25418 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:50:04.269635 25419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:04.269215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:33034)
0811 06:50:04.269367 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:04.269462 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 06:50:04.269853 24207 master_runner.cc:186] Error getting master registration for 127.12.145.62:38107: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111),
I20260811 06:50:04.270009 24207 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 06:50:04.286672 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:04.286801 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:04.407735 25422 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9648bd90acc94b9eb272c8cd354f5276)
I20260811 06:50:04.407965 25422 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } }
I20260811 06:50:04.408561 25422 leader_election.cc:288] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107)
I20260811 06:50:04.409713 25425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:04.408827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:33046)
0811 06:50:04.409311 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:04.409449 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":239,"threads_started":1}
I20260811 06:50:04.411149 25425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:04.410813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:33052)
0811 06:50:04.410946 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:04.411030 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 06:50:04.411327 24239 leader_election.cc:334] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:50:04.411497 24239 leader_election.cc:302] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a3d34b77fc8a45a2b90990349f984422; no voters: 9648bd90acc94b9eb272c8cd354f5276
I20260811 06:50:04.411820 25422 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:50:04.511658 25427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:04.510702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:52427)
0811 06:50:04.511294 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:04.511403 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":311,"threads_started":1}
I20260811 06:50:04.519037 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:04.518171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:43741)
0811 06:50:04.518710 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:04.518820 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":284,"threads_started":1}
I20260811 06:50:04.524317 25431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:04.523527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:38619)
0811 06:50:04.524050 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:04.524145 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":273,"threads_started":1}
W20260811 06:50:05.288097 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:05.288233 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:05.513419 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:05.512546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:38793)
0811 06:50:05.513078 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:05.513172 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":295,"threads_started":1}
I20260811 06:50:05.520735 25436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:05.520010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:54613)
0811 06:50:05.520462 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:05.520567 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":232,"threads_started":1}
I20260811 06:50:05.526083 25437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:05.525237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:54011)
0811 06:50:05.525717 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:05.525823 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":233,"threads_started":1}
I20260811 06:50:06.204491 25440 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9648bd90acc94b9eb272c8cd354f5276)
I20260811 06:50:06.204691 25440 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } }
I20260811 06:50:06.205273 25440 leader_election.cc:288] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107)
I20260811 06:50:06.206348 25441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:06.205558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:33160)
0811 06:50:06.206044 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:06.206146 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":189,"threads_started":1}
I20260811 06:50:06.207612 25441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:06.207283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:33168)
0811 06:50:06.207426 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:06.207501 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 06:50:06.207772 24239 leader_election.cc:334] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:50:06.207916 24239 leader_election.cc:302] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a3d34b77fc8a45a2b90990349f984422; no voters: 9648bd90acc94b9eb272c8cd354f5276
I20260811 06:50:06.208210 25440 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 06:50:06.289455 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:06.289623 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:06.515182 25443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:06.514344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:40443)
0811 06:50:06.514895 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:06.514998 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":306,"threads_started":1}
I20260811 06:50:06.522480 25444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:06.521670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:49931)
0811 06:50:06.522193 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:06.522279 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":270,"threads_started":1}
I20260811 06:50:06.527643 25445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:06.526904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:42551)
0811 06:50:06.527331 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:06.527446 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":198,"threads_started":1}
W20260811 06:50:07.290910 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:07.291055 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:07.516832 25446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:07.516070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:38485)
0811 06:50:07.516506 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:07.516603 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":231,"threads_started":1}
I20260811 06:50:07.524082 25447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:07.523351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:37573)
0811 06:50:07.523794 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:07.523879 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":224,"threads_started":1}
I20260811 06:50:07.529207 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:07.528444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:38149)
0811 06:50:07.528894 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:07.529000 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":241,"threads_started":1}
W20260811 06:50:08.292299 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:08.292441 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:08.518792 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:08.517911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:52745)
0811 06:50:08.518455 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:08.518555 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":294,"threads_started":1}
I20260811 06:50:08.525731 25454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:08.524940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:41007)
0811 06:50:08.525391 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:08.525490 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":211,"threads_started":1}
I20260811 06:50:08.530853 25455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:08.530023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:44329)
0811 06:50:08.530475 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:08.530606 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":248,"threads_started":1}
I20260811 06:50:09.271668 25456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:09.270793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:34186)
0811 06:50:09.271307 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:09.271438 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":227,"threads_started":1}
I20260811 06:50:09.271921 24207 master_runner.cc:186] Error getting master registration for 127.12.145.62:38107: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111),
I20260811 06:50:09.272095 24207 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 06:50:09.293715 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:09.293833 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:09.520459 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:09.519693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:47551)
0811 06:50:09.520170 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:09.520270 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":258,"threads_started":1}
I20260811 06:50:09.527393 25460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:09.526646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:51611)
0811 06:50:09.527102 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:09.527193 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":208,"threads_started":1}
I20260811 06:50:09.532411 25463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:09.531676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:50197)
0811 06:50:09.532088 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:09.532197 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":211,"threads_started":1}
W20260811 06:50:10.295064 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:10.295215 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:10.522399 25466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:10.521577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:45327)
0811 06:50:10.522072 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:10.522170 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":263,"threads_started":1}
I20260811 06:50:10.529245 25468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:10.528366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:37983)
0811 06:50:10.528950 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:10.529063 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":329,"threads_started":1}
I20260811 06:50:10.534144 25470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:10.533280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:60877)
0811 06:50:10.533838 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:10.533961 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":290,"threads_started":1}
W20260811 06:50:11.296489 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:11.296633 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:11.524333 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:11.523413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:41679)
0811 06:50:11.523978 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:11.524111 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":279,"threads_started":1}
I20260811 06:50:11.531002 25473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:11.530163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:48217)
0811 06:50:11.530662 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:11.530788 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":246,"threads_started":1}
I20260811 06:50:11.535727 25475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:11.534918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:44685)
0811 06:50:11.535413 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:11.535542 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":243,"threads_started":1}
W20260811 06:50:12.297940 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:12.298079 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:12.526399 25476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:12.525417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:55169)
0811 06:50:12.526001 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:12.526144 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":306,"threads_started":1}
I20260811 06:50:12.532618 25478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:12.531857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:60001)
0811 06:50:12.532333 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:12.532433 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":251,"threads_started":1}
I20260811 06:50:12.537436 25479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:12.536544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:47627)
0811 06:50:12.537071 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:12.537198 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":287,"threads_started":1}
I20260811 06:50:13.200430 25480 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9648bd90acc94b9eb272c8cd354f5276)
I20260811 06:50:13.200670 25480 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } attrs { promote: false } }
I20260811 06:50:13.201246 25480 leader_election.cc:288] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107)
I20260811 06:50:13.202482 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:13.201564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:34396)
0811 06:50:13.202091 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:13.202236 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":278,"threads_started":1}
W20260811 06:50:13.202679 24239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260811 06:50:13.203938 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:13.203594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:34412)
0811 06:50:13.203745 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:13.203818 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 06:50:13.204105 24239 leader_election.cc:334] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:50:13.204206 24239 leader_election.cc:302] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a3d34b77fc8a45a2b90990349f984422; no voters: 9648bd90acc94b9eb272c8cd354f5276
I20260811 06:50:13.204420 25480 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 06:50:13.299273 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:13.299404 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:13.528563 25485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:13.527579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:42915)
0811 06:50:13.528153 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:13.528255 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":273,"threads_started":1}
I20260811 06:50:13.534252 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:13.533497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:37661)
0811 06:50:13.534002 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:13.534090 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":245,"threads_started":1}
I20260811 06:50:13.539049 25487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:13.538278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:34003)
0811 06:50:13.538748 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:13.538853 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":235,"threads_started":1}
I20260811 06:50:14.273841 25488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:14.272909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:34452)
0811 06:50:14.273445 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:14.273612 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":251,"threads_started":1}
I20260811 06:50:14.274108 24207 master_runner.cc:186] Error getting master registration for 127.12.145.62:38107: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111),
I20260811 06:50:14.274274 24207 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 06:50:14.300630 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:14.300781 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:14.530648 25491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:14.529688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:46813)
0811 06:50:14.530254 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:14.530374 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":313,"threads_started":1}
I20260811 06:50:14.535894 25494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:14.535118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:46337)
0811 06:50:14.535614 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:14.535700 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":258,"threads_started":1}
I20260811 06:50:14.540486 25495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:14.539829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:54705)
0811 06:50:14.540212 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:14.540293 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":183,"threads_started":1}
W20260811 06:50:15.302089 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:15.302223 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:15.532532 25497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:15.531655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:39735)
0811 06:50:15.532189 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:15.532302 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":259,"threads_started":1}
I20260811 06:50:15.537722 25498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:15.536904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:43567)
0811 06:50:15.537398 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:15.537546 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":250,"threads_started":1}
I20260811 06:50:15.542174 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:15.541356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:59491)
0811 06:50:15.541841 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:15.541958 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":260,"threads_started":1}
W20260811 06:50:16.303460 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:16.303606 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:16.474944 25507 raft_consensus.cc:482] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:50:16.475158 25507 raft_consensus.cc:504] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9648bd90acc94b9eb272c8cd354f5276" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 38107 } } peers { permanent_uuid: "a3d34b77fc8a45a2b90990349f984422" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39497 } } peers { permanent_uuid: "446c9e60cef64b7eb97cfdc7245683fe" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36287 } }
I20260811 06:50:16.475829 25507 leader_election.cc:288] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107), a3d34b77fc8a45a2b90990349f984422 (127.12.145.61:39497)
I20260811 06:50:16.476488 24282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "446c9e60cef64b7eb97cfdc7245683fe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d34b77fc8a45a2b90990349f984422" is_pre_election: true
I20260811 06:50:16.476702 24282 raft_consensus.cc:1799] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Handling vote request from an unknown peer 446c9e60cef64b7eb97cfdc7245683fe
I20260811 06:50:16.476887 24282 raft_consensus.cc:2396] T 00000000000000000000000000000000 P a3d34b77fc8a45a2b90990349f984422 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 446c9e60cef64b7eb97cfdc7245683fe for term 2 because replica has last-logged OpId of term: 1 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260811 06:50:16.477090 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:16.476097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:34524)
0811 06:50:16.476597 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:16.476770 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":267,"threads_started":1}
W20260811 06:50:16.477319 24370 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:50:16.478518 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:16.478205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.0.0.1:34532)
0811 06:50:16.478338 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:16.478410 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 06:50:16.478688 24370 leader_election.cc:334] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9648bd90acc94b9eb272c8cd354f5276 (127.12.145.62:38107): Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
I20260811 06:50:16.478811 24370 leader_election.cc:302] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 446c9e60cef64b7eb97cfdc7245683fe; no voters: 9648bd90acc94b9eb272c8cd354f5276, a3d34b77fc8a45a2b90990349f984422
I20260811 06:50:16.479063 25507 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:50:16.534498 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:16.533503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.3:52903)
0811 06:50:16.534115 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:16.534239 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":271,"threads_started":1}
I20260811 06:50:16.539249 25515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:16.538576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.2:41117)
0811 06:50:16.538971 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:16.539063 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":187,"threads_started":1}
I20260811 06:50:16.543736 25516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:16.542983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:38107 (local address 127.12.145.1:37897)
0811 06:50:16.543399 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:16.543566 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:38107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":201,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:903: Failure
Failed
Bad status: Timed out: Could not connect to the cluster: ConnectToClusterRpc(addrs: 127.12.145.62:38107,127.12.145.61:39497,127.12.145.60:36287, num_attempts: 241) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.12.145.62:38107,127.12.145.61:39497,127.12.145.60:36287, num_attempts: 1)
I20260811 06:50:16.733592 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 24491
I20260811 06:50:16.747176 25523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:16.734526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38368 (local address 127.12.145.1:37049)
0811 06:50:16.735047 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:16.735051 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:16.735072 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:50:16.735131 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:16.735135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:16.735217 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:16.735308 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:16.736706 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:16.737510 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:16.738788 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:16.739188 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:16.739287 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:16.741646 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:16.741662 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:16.741681 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:16.741713 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:16.744435 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:16.745040 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:16.745047 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:16.745050 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:16.745171 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:16.745448 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:16.745451 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:16.745453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:16.745909 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:16.746146 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:16.746628 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 06:50:16.746795 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":262,"threads_started":1}
I20260811 06:50:16.747900 24689 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:16.845299 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 24491
I20260811 06:50:16.874775 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 24720
I20260811 06:50:16.889150 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:16.875662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48322 (local address 127.12.145.2:42157)
0811 06:50:16.876273 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:16.876278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:16.876295 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:50:16.876353 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:16.876357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:16.876429 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:16.876549 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:16.877984 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:16.878764 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:16.880006 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:16.880420 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:16.880564 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:16.883215 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:16.883233 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:16.883250 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:16.883289 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:16.886261 (+ 2972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:16.886998 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:16.887006 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:16.887009 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:16.887155 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:16.887538 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:16.887542 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:16.887544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:16.887934 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:16.888248 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:16.888570 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 06:50:16.888815 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":327,"threads_started":1}
I20260811 06:50:16.889914 24919 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:16.986950 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 24720
I20260811 06:50:17.011802 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 24943
I20260811 06:50:17.025490 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:17.012674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39372 (local address 127.12.145.3:45279)
0811 06:50:17.013253 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:17.013257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:17.013275 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:50:17.013335 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:17.013340 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:17.013406 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:17.013506 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:17.014831 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:17.015663 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:17.016911 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:17.017387 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:17.017500 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:17.020283 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:17.020300 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:17.020319 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:17.020353 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:17.023183 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:17.023769 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:17.023775 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:17.023778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:17.023955 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:17.024242 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:17.024245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:17.024247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:17.024609 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:17.024846 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:17.025046 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 06:50:17.025213 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":323,"threads_started":1}
I20260811 06:50:17.026217 25165 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:17.148798 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 24943
I20260811 06:50:17.180058 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 24019
I20260811 06:50:17.181270 24312 generic_service.cc:196] Checking for leaks (request via RPC)
W20260811 06:50:17.304842 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c9e60cef64b7eb97cfdc7245683fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:50:17.305001 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:50:17.306156 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 24019
I20260811 06:50:17.331892 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 24207
I20260811 06:50:17.333107 24438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:17.449200 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 24207
2026-08-11T06:50:17Z chronyd exiting
I20260811 06:50:17.490106 12868 test_util.cc:175] -----------------------------------------------
I20260811 06:50:17.490236 12868 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786430925511755-12868-0
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (37973 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:50:17 dist-test-slave-7lbf krb5kdc[25538](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:50:17 dist-test-slave-7lbf krb5kdc[25538](info): set up 2 sockets
Aug 11 06:50:17 dist-test-slave-7lbf krb5kdc[25538](info): commencing operation
krb5kdc: starting...
W20260811 06:50:18.699548 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:50:18 dist-test-slave-7lbf krb5kdc[25538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:50:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:50:18Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.62.keytab.
Entry for principal oryx/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.62.keytab.
I20260811 06:50:18.961141 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:36875
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.62.keytab
--principal=oryx/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:32851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:36875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:19.301232 25560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:19.301577 25560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:19.301716 25560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:19.308961 25560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:50:19.309079 25560 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 06:50:19.309149 25560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:19.309232 25560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:19.309297 25560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:50:19.309383 25560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:50:19.319319 25560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:32851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:36875
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.62.keytab
--principal=oryx/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:36875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:19.320644 25560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:19.322034 25560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:19.333716 25571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:19.333771 25576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:19.333668 25572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:19.334654 25560 server_base.cc:1034] running on GCE node
I20260811 06:50:19.335415 25560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:19.336790 25560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:19.338008 25560 hybrid_clock.cc:648] HybridClock initialized: now 1786431019337934 us; error 38 us; skew 500 ppm
I20260811 06:50:19.338361 25560 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:19 dist-test-slave-7lbf krb5kdc[25538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431019, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:19.341395 25560 init.cc:377] Logged in from keytab as oryx/127.12.145.62@KRBTEST.COM (short username oryx)
I20260811 06:50:19.342904 25560 webserver.cc:460] Webserver started at http://127.12.145.62:40267/ using document root <none> and password file <none>
I20260811 06:50:19.343593 25560 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:19.343696 25560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:19.344027 25560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:19.347090 25560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "9323fbc1b6714196a58ce31f3f466655"
format_stamp: "Formatted at 2026-08-11 06:50:19 on dist-test-slave-7lbf"
server_key: "b8aa5b3cd8b861aaca0b32c161cc734e"
server_key_iv: "cbd2a753f50207c768758bdb6683c5ba"
server_key_version: "encryptionkey@0"
I20260811 06:50:19.347934 25560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "9323fbc1b6714196a58ce31f3f466655"
format_stamp: "Formatted at 2026-08-11 06:50:19 on dist-test-slave-7lbf"
server_key: "b8aa5b3cd8b861aaca0b32c161cc734e"
server_key_iv: "cbd2a753f50207c768758bdb6683c5ba"
server_key_version: "encryptionkey@0"
I20260811 06:50:19.353015 25560 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:50:19.356420 25586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:19.357769 25560 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:50:19.357939 25560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "9323fbc1b6714196a58ce31f3f466655"
format_stamp: "Formatted at 2026-08-11 06:50:19 on dist-test-slave-7lbf"
server_key: "b8aa5b3cd8b861aaca0b32c161cc734e"
server_key_iv: "cbd2a753f50207c768758bdb6683c5ba"
server_key_version: "encryptionkey@0"
I20260811 06:50:19.358130 25560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:19.381831 25560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:19.386013 25560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:19.386276 25560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:19.406922 25560 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:36875
I20260811 06:50:19.406931 25703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:36875 every 8 connection(s)
I20260811 06:50:19.408335 25560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:50:19.412215 25706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:19.415486 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 25560
I20260811 06:50:19.415735 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:50:19.416515 12868 external_mini_cluster.cc:1428] Setting key 92807116f2924b80e02118eb4be65964
I20260811 06:50:19.425354 25706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655: Bootstrap starting.
I20260811 06:50:19.429373 25706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:19.430809 25706 log.cc:824] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655: Log is configured to *not* fsync() on all Append() calls
Aug 11 06:50:19 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:50:19.434058 25706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655: No bootstrap required, opened a new log
I20260811 06:50:19.439872 25713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:19.418648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40518 (local address 127.12.145.62:36875)
0811 06:50:19.419424 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:19.419435 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:19.419477 (+ 42us) server_negotiation.cc:407] Connection header received
0811 06:50:19.421214 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:19.421243 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:19.421720 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:19.422081 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:19.423908 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:19.425283 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:19.427038 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:19.427737 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:19.427888 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:19.432613 (+ 4725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:19.432621 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:19.432636 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:19.432672 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:19.435727 (+ 3055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:19.436553 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:19.436559 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:19.436565 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:19.436758 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:19.437178 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:19.437181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:19.437183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:19.437758 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:19.438000 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:19.438432 (+ 432us) server_negotiation.cc:299] Negotiation successful
0811 06:50:19.438806 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":362,"threads_started":1}
I20260811 06:50:19.443156 25706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9323fbc1b6714196a58ce31f3f466655" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36875 } }
I20260811 06:50:19.443516 25706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:19.443607 25706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9323fbc1b6714196a58ce31f3f466655, State: Initialized, Role: FOLLOWER
I20260811 06:50:19.444168 25706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9323fbc1b6714196a58ce31f3f466655" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36875 } }
I20260811 06:50:19.444401 25706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:50:19.444532 25706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:50:19.444696 25706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:19.447172 25706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9323fbc1b6714196a58ce31f3f466655" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36875 } }
I20260811 06:50:19.447664 25706 leader_election.cc:302] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9323fbc1b6714196a58ce31f3f466655; no voters:
I20260811 06:50:19.448220 25706 leader_election.cc:288] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:50:19.448365 25718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:19.449177 25718 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [term 1 LEADER]: Becoming Leader. State: Replica: 9323fbc1b6714196a58ce31f3f466655, State: Running, Role: LEADER
I20260811 06:50:19.449743 25718 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9323fbc1b6714196a58ce31f3f466655" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36875 } }
I20260811 06:50:19.450286 25706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:50:19.452689 25720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9323fbc1b6714196a58ce31f3f466655" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9323fbc1b6714196a58ce31f3f466655" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36875 } } }
I20260811 06:50:19.453114 25720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:19.453663 25723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9323fbc1b6714196a58ce31f3f466655. Latest consensus state: current_term: 1 leader_uuid: "9323fbc1b6714196a58ce31f3f466655" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9323fbc1b6714196a58ce31f3f466655" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36875 } } }
I20260811 06:50:19.454010 25723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655 [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:19.454077 25738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:50:19.462317 25738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:50:19.473373 25738 catalog_manager.cc:1347] Generated new cluster ID: 44c97dd5bb8d4768be9471b9d4f95618
I20260811 06:50:19.473507 25738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:50:19.489964 25738 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:50:19.491991 25738 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:50:19.502660 25738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655: Generated new TSK 0
I20260811 06:50:19.503532 25738 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab.
Entry for principal oryx/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab.
I20260811 06:50:19.578841 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:36875
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab
--principal=oryx/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:32851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:19.913723 25761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:19.914014 25761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:19.914122 25761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:19.921250 25761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:19.921356 25761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:19.921468 25761 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 06:50:19.921602 25761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:50:19.931596 25761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:32851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab
--principal=oryx/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.62:36875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:19.932883 25761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:19.934267 25761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:19.946913 25772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:19.946964 25770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:19.946887 25774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:19.947762 25761 server_base.cc:1034] running on GCE node
I20260811 06:50:19.948371 25761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:19.949275 25761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:19.950490 25761 hybrid_clock.cc:648] HybridClock initialized: now 1786431019950412 us; error 48 us; skew 500 ppm
I20260811 06:50:19.950811 25761 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:19 dist-test-slave-7lbf krb5kdc[25538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431019, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:19.954017 25761 init.cc:377] Logged in from keytab as oryx/127.12.145.1@KRBTEST.COM (short username oryx)
I20260811 06:50:19.955449 25761 webserver.cc:460] Webserver started at http://127.12.145.1:43487/ using document root <none> and password file <none>
I20260811 06:50:19.956159 25761 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:19.956261 25761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:19.956574 25761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:19.959488 25761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "485b74e6b3ba4899bfce4b9fb1956eef"
format_stamp: "Formatted at 2026-08-11 06:50:19 on dist-test-slave-7lbf"
server_key: "edf84c6ca0d53ced17946bbed4cced71"
server_key_iv: "c3fc0157bd9f9a20defb27d8b2fefa9a"
server_key_version: "encryptionkey@0"
I20260811 06:50:19.960268 25761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "485b74e6b3ba4899bfce4b9fb1956eef"
format_stamp: "Formatted at 2026-08-11 06:50:19 on dist-test-slave-7lbf"
server_key: "edf84c6ca0d53ced17946bbed4cced71"
server_key_iv: "c3fc0157bd9f9a20defb27d8b2fefa9a"
server_key_version: "encryptionkey@0"
I20260811 06:50:19.965592 25761 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:50:19.969008 25784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:19.970486 25761 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 06:50:19.970646 25761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "485b74e6b3ba4899bfce4b9fb1956eef"
format_stamp: "Formatted at 2026-08-11 06:50:19 on dist-test-slave-7lbf"
server_key: "edf84c6ca0d53ced17946bbed4cced71"
server_key_iv: "c3fc0157bd9f9a20defb27d8b2fefa9a"
server_key_version: "encryptionkey@0"
I20260811 06:50:19.970860 25761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:19.984031 25761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:19.988168 25761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:19.988420 25761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:19.991202 25761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:19.991307 25761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:19.991461 25761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:19.991549 25761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 06:50:20 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431019, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:50:20.014317 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:19.991620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:41423 (local address 127.12.145.62:36875)
0811 06:50:19.992470 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:19.992475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:19.993308 (+ 833us) server_negotiation.cc:407] Connection header received
0811 06:50:19.995580 (+ 2272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:19.995587 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:19.995674 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:19.995772 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:19.998045 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:19.999029 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.001588 (+ 2559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.002181 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.002314 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:20.007170 (+ 4856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:20.007175 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:20.007178 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:20.007216 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:20.010426 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:20.011403 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:20.011409 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:20.011413 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:20.011594 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:20.012185 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:20.012191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:20.012195 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:20.012566 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:20.012717 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:20.013680 (+ 963us) server_negotiation.cc:299] Negotiation successful
0811 06:50:20.013913 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":632,"threads_started":1}
I20260811 06:50:20.015723 25801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:19.992319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36875 (local address 127.12.145.1:41423)
0811 06:50:19.993144 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:19.993182 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:19.995271 (+ 2089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:19.996098 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:19.996111 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:19.996911 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:19.997851 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:19.997884 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:19.999185 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:19.999190 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:20.001413 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:20.001429 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.002454 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.002462 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:20.002817 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:20.003673 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:20.003700 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:20.006846 (+ 3146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:20.010579 (+ 3733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:20.010588 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:20.010606 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:20.011241 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:20.011744 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:20.011749 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:20.011752 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:20.012061 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:20.012795 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:20.012814 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:20.013265 (+ 451us) client_negotiation.cc:769] Sending connection context
0811 06:50:20.013563 (+ 298us) client_negotiation.cc:240] Negotiation successful
0811 06:50:20.014203 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":392,"threads_started":1}
I20260811 06:50:20.033313 25761 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:44093
I20260811 06:50:20.033349 25998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:44093 every 8 connection(s)
I20260811 06:50:20.035080 25761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:50:20.037218 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:20.022623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:57509 (local address 127.12.145.62:36875)
0811 06:50:20.022813 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:20.022819 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:20.023468 (+ 649us) server_negotiation.cc:407] Connection header received
0811 06:50:20.023743 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:20.023749 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:20.023842 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:20.023959 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:20.024855 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.026021 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.028272 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.028756 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.028906 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:20.031139 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:20.031144 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:20.031147 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:20.031179 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:20.034229 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:20.034878 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:20.034884 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:20.034887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:20.035079 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:20.035488 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:20.035494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:20.035497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:20.035899 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:20.036076 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:20.036675 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 06:50:20.036899 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:50:20.037267 25958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:20.022670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36875 (local address 127.12.145.1:57509)
0811 06:50:20.023344 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:20.023364 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:20.023598 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:20.024000 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:20.024003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:20.024431 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:20.024726 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:20.024735 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.026209 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.026215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:20.028106 (+ 1891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:20.028125 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.029141 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.029147 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:20.029273 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:20.029984 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:20.030010 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:20.030948 (+ 938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:20.034356 (+ 3408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:20.034360 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:20.034363 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:20.034756 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:20.035234 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:20.035240 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:20.035244 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:20.035378 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:20.036150 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:20.036155 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:20.036387 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 06:50:20.036551 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 06:50:20.036845 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":367,"threads_started":1}
I20260811 06:50:20.037569 26000 heartbeater.cc:347] Connected to a master server at 127.12.145.62:36875
I20260811 06:50:20.037819 26000 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:20.038561 26000 heartbeater.cc:511] Master 127.12.145.62:36875 requested a full tablet report, sending...
I20260811 06:50:20.040820 25615 ts_manager.cc:194] Registered new tserver with Master: 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093)
I20260811 06:50:20.042326 25615 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:41423
I20260811 06:50:20.043853 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 25761
I20260811 06:50:20.044057 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:50:20.044684 12868 external_mini_cluster.cc:1428] Setting key c7d266468aff16c73dbe4194fee6c75b
WARNING: no policy specified for oryx/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab.
Entry for principal oryx/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab.
I20260811 06:50:20.098822 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:36875
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab
--principal=oryx/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:32851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:20.439442 26006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:20.439744 26006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:20.439893 26006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:20.447096 26006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:20.447228 26006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:20.447363 26006 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 06:50:20.447480 26006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:50:20.457456 26006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:32851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab
--principal=oryx/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.62:36875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:20.458799 26006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:20.460120 26006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:20.474152 26016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:20.474201 26018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:20.474680 26015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:20.475250 26006 server_base.cc:1034] running on GCE node
I20260811 06:50:20.475904 26006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:20.476847 26006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:20.478082 26006 hybrid_clock.cc:648] HybridClock initialized: now 1786431020478006 us; error 45 us; skew 500 ppm
I20260811 06:50:20.478384 26006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:20 dist-test-slave-7lbf krb5kdc[25538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431020, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:20.481477 26006 init.cc:377] Logged in from keytab as oryx/127.12.145.2@KRBTEST.COM (short username oryx)
I20260811 06:50:20.482861 26006 webserver.cc:460] Webserver started at http://127.12.145.2:42751/ using document root <none> and password file <none>
I20260811 06:50:20.483515 26006 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:20.483599 26006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:20.483877 26006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:20.486745 26006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "69cf5397059e46779e9a25fd46fe7f83"
format_stamp: "Formatted at 2026-08-11 06:50:20 on dist-test-slave-7lbf"
server_key: "181a6717c01c3677b0b56545fb248689"
server_key_iv: "994ccc61010da65600ad6f0f92fb2d7b"
server_key_version: "encryptionkey@0"
I20260811 06:50:20.487474 26006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "69cf5397059e46779e9a25fd46fe7f83"
format_stamp: "Formatted at 2026-08-11 06:50:20 on dist-test-slave-7lbf"
server_key: "181a6717c01c3677b0b56545fb248689"
server_key_iv: "994ccc61010da65600ad6f0f92fb2d7b"
server_key_version: "encryptionkey@0"
I20260811 06:50:20.492362 26006 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:50:20.495743 26027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:20.496990 26006 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:50:20.497136 26006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "69cf5397059e46779e9a25fd46fe7f83"
format_stamp: "Formatted at 2026-08-11 06:50:20 on dist-test-slave-7lbf"
server_key: "181a6717c01c3677b0b56545fb248689"
server_key_iv: "994ccc61010da65600ad6f0f92fb2d7b"
server_key_version: "encryptionkey@0"
I20260811 06:50:20.497330 26006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:20.512447 26006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:20.516160 26006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:20.516448 26006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:20.519268 26006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:20.519368 26006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:20.519522 26006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:20.519593 26006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 06:50:20 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431020, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:50:20.541703 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:20.519610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:46889 (local address 127.12.145.62:36875)
0811 06:50:20.519809 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:20.519816 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:20.521200 (+ 1384us) server_negotiation.cc:407] Connection header received
0811 06:50:20.523330 (+ 2130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:20.523337 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:20.523433 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:20.523559 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:20.525675 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.526852 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.529249 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.529948 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.530087 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:20.534868 (+ 4781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:20.534876 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:20.534880 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:20.534925 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:20.538150 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:20.539136 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:20.539140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:20.539142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:20.539273 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:20.539766 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:20.539769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:20.539771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:20.540039 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:20.540157 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:20.541080 (+ 923us) server_negotiation.cc:299] Negotiation successful
0811 06:50:20.541306 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 06:50:20.543342 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:20.520284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36875 (local address 127.12.145.2:46889)
0811 06:50:20.521045 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:20.521085 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:20.523007 (+ 1922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:20.523817 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:20.523827 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:20.524484 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:20.525390 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:20.525415 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.527014 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.527018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:20.529079 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:20.529099 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.530284 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.530293 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:20.530592 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:20.531365 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:20.531388 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:20.534612 (+ 3224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:20.538293 (+ 3681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:20.538304 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:20.538325 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:20.539018 (+ 693us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:20.539364 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:20.539369 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:20.539373 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:20.539668 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:20.540146 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:20.540154 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:20.540642 (+ 488us) client_negotiation.cc:769] Sending connection context
0811 06:50:20.540982 (+ 340us) client_negotiation.cc:240] Negotiation successful
0811 06:50:20.541613 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":319,"threads_started":1}
I20260811 06:50:20.564814 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:20.550451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:37503 (local address 127.12.145.62:36875)
0811 06:50:20.550667 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:20.550673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:20.551396 (+ 723us) server_negotiation.cc:407] Connection header received
0811 06:50:20.551674 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:20.551682 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:20.551768 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:20.551847 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:20.553551 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.554465 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.556283 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.556722 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.556833 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:20.559045 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:20.559050 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:20.559053 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:20.559085 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:20.561612 (+ 2527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:20.562441 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:20.562446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:20.562450 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:20.562629 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:20.563104 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:20.563110 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:20.563113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:20.563499 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:20.563662 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:20.564241 (+ 579us) server_negotiation.cc:299] Negotiation successful
0811 06:50:20.564491 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 06:50:20.565008 26194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:20.550486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36875 (local address 127.12.145.2:37503)
0811 06:50:20.551285 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:20.551310 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:20.551480 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:20.552222 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:20.552227 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:20.552896 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:20.553330 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:20.553349 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.554619 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.554625 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:20.556150 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:20.556166 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:20.556915 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:20.556923 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:20.557085 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:20.557706 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:20.557728 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:20.558852 (+ 1124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:20.561730 (+ 2878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:20.561735 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:20.561740 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:20.562335 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:20.562756 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:20.562761 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:20.562764 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:20.562959 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:20.563640 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:20.563645 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:20.563904 (+ 259us) client_negotiation.cc:769] Sending connection context
0811 06:50:20.564116 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 06:50:20.564510 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":362,"threads_started":1}
I20260811 06:50:20.566813 26006 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:35281
I20260811 06:50:20.566823 26241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:35281 every 8 connection(s)
I20260811 06:50:20.568207 26006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:50:20.570490 26243 heartbeater.cc:347] Connected to a master server at 127.12.145.62:36875
I20260811 06:50:20.570720 26243 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:20.571354 26243 heartbeater.cc:511] Master 127.12.145.62:36875 requested a full tablet report, sending...
I20260811 06:50:20.572635 25615 ts_manager.cc:194] Registered new tserver with Master: 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281)
I20260811 06:50:20.573431 25615 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:46889
I20260811 06:50:20.576309 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 26006
I20260811 06:50:20.576473 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:50:20.576907 12868 external_mini_cluster.cc:1428] Setting key 32304d3dea361c5d9a9f4f6fd10eaca3
WARNING: no policy specified for oryx/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab.
Entry for principal oryx/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab.
I20260811 06:50:20.630923 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:36875
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab
--principal=oryx/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:32851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:20.973688 26250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:20.973975 26250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:20.974084 26250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:20.981352 26250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:20.981478 26250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:20.981608 26250 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 06:50:20.981701 26250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:50:20.991451 26250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:32851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab
--principal=oryx/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.62:36875
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:20.992702 26250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:20.994025 26250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:21.007258 26262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:21.007296 26268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:21.007251 26260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:21.011006 26250 server_base.cc:1034] running on GCE node
I20260811 06:50:21.011700 26250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:21.012701 26250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:21.013932 26250 hybrid_clock.cc:648] HybridClock initialized: now 1786431021013858 us; error 44 us; skew 500 ppm
I20260811 06:50:21.014242 26250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:21 dist-test-slave-7lbf krb5kdc[25538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431021, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:21.017346 26250 init.cc:377] Logged in from keytab as oryx/127.12.145.3@KRBTEST.COM (short username oryx)
I20260811 06:50:21.018905 26250 webserver.cc:460] Webserver started at http://127.12.145.3:39799/ using document root <none> and password file <none>
I20260811 06:50:21.019641 26250 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:21.019728 26250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:21.020006 26250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:21.022938 26250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "38de9892de5e4b6b95444ea3d2ac938b"
format_stamp: "Formatted at 2026-08-11 06:50:21 on dist-test-slave-7lbf"
server_key: "3100f14cd7d4eb945bdd807c5881df47"
server_key_iv: "cedc6bcb2dc3b1f2aba01522a4c13ab3"
server_key_version: "encryptionkey@0"
I20260811 06:50:21.023756 26250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "38de9892de5e4b6b95444ea3d2ac938b"
format_stamp: "Formatted at 2026-08-11 06:50:21 on dist-test-slave-7lbf"
server_key: "3100f14cd7d4eb945bdd807c5881df47"
server_key_iv: "cedc6bcb2dc3b1f2aba01522a4c13ab3"
server_key_version: "encryptionkey@0"
I20260811 06:50:21.028959 26250 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 06:50:21.032596 26279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:21.034135 26250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:50:21.034291 26250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "38de9892de5e4b6b95444ea3d2ac938b"
format_stamp: "Formatted at 2026-08-11 06:50:21 on dist-test-slave-7lbf"
server_key: "3100f14cd7d4eb945bdd807c5881df47"
server_key_iv: "cedc6bcb2dc3b1f2aba01522a4c13ab3"
server_key_version: "encryptionkey@0"
I20260811 06:50:21.034512 26250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:21.044993 26000 heartbeater.cc:503] Master 127.12.145.62:36875 was elected leader, sending a full tablet report...
I20260811 06:50:21.051069 26250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:21.055083 26250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:21.055308 26250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:21.058089 26250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:21.058171 26250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:21.058306 26250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:21.058378 26250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 06:50:21 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431021, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:50:21.081591 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:21.058630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:42123 (local address 127.12.145.62:36875)
0811 06:50:21.058826 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:21.058832 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:21.060324 (+ 1492us) server_negotiation.cc:407] Connection header received
0811 06:50:21.062831 (+ 2507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:21.062839 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:21.062936 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:21.063048 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:21.065252 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:21.066525 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:21.069006 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:21.069572 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:21.069699 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:21.074255 (+ 4556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:21.074260 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:21.074264 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:21.074299 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:21.077304 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:21.078438 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:21.078444 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:21.078447 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:21.078621 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:21.079215 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:21.079221 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:21.079225 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:21.079626 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:21.079780 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:21.080917 (+ 1137us) server_negotiation.cc:299] Negotiation successful
0811 06:50:21.081191 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 06:50:21.083065 26294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:21.059246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36875 (local address 127.12.145.3:42123)
0811 06:50:21.060123 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:21.060177 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:21.062432 (+ 2255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:21.063317 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:21.063325 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:21.064056 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:21.064959 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:21.064982 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:21.066705 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:21.066709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:21.068788 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:21.068808 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:21.069826 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:21.069834 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:21.070172 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:21.070921 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:21.070958 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:21.074017 (+ 3059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:21.077467 (+ 3450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:21.077477 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:21.077501 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:21.078288 (+ 787us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:21.078751 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:21.078756 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:21.078760 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:21.079087 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:21.079860 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:21.079869 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:21.080397 (+ 528us) client_negotiation.cc:769] Sending connection context
0811 06:50:21.080793 (+ 396us) client_negotiation.cc:240] Negotiation successful
0811 06:50:21.081431 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":363,"threads_started":1}
I20260811 06:50:21.104036 26250 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:43441
I20260811 06:50:21.104089 26496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:43441 every 8 connection(s)
I20260811 06:50:21.105255 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:21.089017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:44871 (local address 127.12.145.62:36875)
0811 06:50:21.089180 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:21.089184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:21.090218 (+ 1034us) server_negotiation.cc:407] Connection header received
0811 06:50:21.090446 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:21.090452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:21.090561 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:21.090663 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:21.092121 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:21.093245 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:21.095185 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:21.095830 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:21.095973 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:21.098810 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:21.098817 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:21.098821 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:21.098864 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:21.102302 (+ 3438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:21.103078 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:21.103084 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:21.103087 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:21.103270 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:21.103775 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:21.103780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:21.103783 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:21.104209 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:21.104372 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:21.104819 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 06:50:21.105009 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 06:50:21.105507 26419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:21.089211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36875 (local address 127.12.145.3:44871)
0811 06:50:21.090071 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:21.090104 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:21.090271 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:21.090714 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:21.090720 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:21.091466 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:21.091935 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:21.091953 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:21.093399 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:21.093405 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:21.095029 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:21.095043 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:21.096104 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:21.096111 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:21.096296 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:21.097096 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:21.097122 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:21.098528 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:21.102430 (+ 3902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:21.102435 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:21.102438 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:21.102921 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:21.103434 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:21.103440 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:21.103444 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:21.103631 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:21.104345 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:21.104350 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:21.104565 (+ 215us) client_negotiation.cc:769] Sending connection context
0811 06:50:21.104713 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 06:50:21.105066 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":476,"threads_started":1}
I20260811 06:50:21.105775 26250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:50:21.108197 26497 heartbeater.cc:347] Connected to a master server at 127.12.145.62:36875
I20260811 06:50:21.108697 26497 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:21.109601 26497 heartbeater.cc:511] Master 127.12.145.62:36875 requested a full tablet report, sending...
I20260811 06:50:21.110925 25615 ts_manager.cc:194] Registered new tserver with Master: 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441)
I20260811 06:50:21.111716 25615 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:42123
I20260811 06:50:21.114521 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 26250
I20260811 06:50:21.114684 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:50:21.115119 12868 external_mini_cluster.cc:1428] Setting key 1b2adb66fdfec1be71f7aa5672abf56d
I20260811 06:50:21.117985 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 06:50:21 dist-test-slave-7lbf krb5kdc[25538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431021, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 06:50:21 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:21 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:21.575846 26243 heartbeater.cc:503] Master 127.12.145.62:36875 was elected leader, sending a full tablet report...
I20260811 06:50:22.114143 26497 heartbeater.cc:503] Master 127.12.145.62:36875 was elected leader, sending a full tablet report...
W20260811 06:50:22.256909 26512 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.085s user 0.005s sys 0.013s
W20260811 06:50:22.258212 25799 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:21.166542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40534 (local address 127.12.145.62:36875)
0811 06:50:21.166756 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:21.166763 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:21.167093 (+ 330us) server_negotiation.cc:407] Connection header received
0811 06:50:21.167286 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:21.167291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:21.167375 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:21.167464 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:21.168852 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:21.169666 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:21.170932 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:21.171363 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:21.171489 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.257892 (+1086403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40534: BlockingRecv error: recv got EOF from 127.0.0.1:40534 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 06:50:22 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431021, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:50:22.281457 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.262589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40542 (local address 127.12.145.62:36875)
0811 06:50:22.262759 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.262765 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.263023 (+ 258us) server_negotiation.cc:407] Connection header received
0811 06:50:22.263174 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.263178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.263278 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.263386 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:22.264650 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.265399 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.266646 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.267087 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.267185 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.276615 (+ 9430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:22.276622 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:22.276626 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:22.276665 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:22.279321 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:22.279918 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:22.279921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:22.279924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:22.280048 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:22.280312 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:22.280314 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:22.280316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:22.280582 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:22.280783 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.281028 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.281212 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:50:22.285706 25615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:50:22.292619 25615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:50:22.316175 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.305191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:43441 (local address 127.0.0.1:48328)
0811 06:50:22.305896 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:22.305928 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:22.306082 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:22.307593 (+ 1511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:22.307600 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:22.307630 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:22.308083 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.308097 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.310245 (+ 2148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.310251 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.312758 (+ 2507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.312775 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.314832 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.314843 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.315150 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.315269 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 06:50:22.315393 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 06:50:22.315660 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":136,"thread_start_us":367,"threads_started":1}
I20260811 06:50:22.316200 26531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.306435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:35281 (local address 127.0.0.1:34990)
0811 06:50:22.307107 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:22.307124 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:22.307229 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:22.308299 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:22.308304 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:22.308329 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:22.308746 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.308759 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.310826 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.310831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.312908 (+ 2077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.312921 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.314861 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.314867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.315157 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.315269 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 06:50:22.315393 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 06:50:22.315660 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":112,"thread_start_us":383,"threads_started":1}
I20260811 06:50:22.317157 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.306712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34990 (local address 127.12.145.2:35281)
0811 06:50:22.307722 (+ 1010us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.307731 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.307758 (+ 27us) server_negotiation.cc:407] Connection header received
0811 06:50:22.307852 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.307859 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.308097 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.308937 (+ 840us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:22.309153 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.310676 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.313108 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.314563 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.316230 (+ 1667us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.316609 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.316687 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.316860 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":857,"thread_start_us":708,"threads_started":1}
I20260811 06:50:22.317397 26530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.305405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48328 (local address 127.12.145.3:43441)
0811 06:50:22.306920 (+ 1515us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.306929 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.306959 (+ 30us) server_negotiation.cc:407] Connection header received
0811 06:50:22.307065 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.307072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.307327 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.308330 (+ 1003us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:22.308554 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.310097 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.313003 (+ 2906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.314571 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.316701 (+ 2130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.316899 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.316973 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.317128 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1342,"thread_start_us":1458,"threads_started":1}
I20260811 06:50:22.321571 26111 tablet_service.cc:1467] Processing CreateTablet for tablet 249171883a7a44658540b4ee628a832e (DEFAULT_TABLE table=test-table [id=d734312d790b40e6bfc24ec91a9f4250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:22.321568 26372 tablet_service.cc:1467] Processing CreateTablet for tablet 249171883a7a44658540b4ee628a832e (DEFAULT_TABLE table=test-table [id=d734312d790b40e6bfc24ec91a9f4250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:22.322883 26111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 249171883a7a44658540b4ee628a832e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:22.322949 26372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 249171883a7a44658540b4ee628a832e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:22.324436 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.307800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44093 (local address 127.0.0.1:34322)
0811 06:50:22.316455 (+ 8655us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:22.316474 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:22.316586 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:22.318032 (+ 1446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:22.318036 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:22.318058 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:22.318241 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.318249 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.320091 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.320097 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.321876 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.321892 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.323684 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.323690 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.323872 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.323905 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 06:50:22.323999 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 06:50:22.324140 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8552,"thread_start_us":9638,"threads_started":1}
I20260811 06:50:22.325695 26538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.307851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34322 (local address 127.12.145.1:44093)
0811 06:50:22.316875 (+ 9024us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.316885 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.316919 (+ 34us) server_negotiation.cc:407] Connection header received
0811 06:50:22.317025 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.317032 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.317277 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.318387 (+ 1110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:22.318565 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.319932 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.322052 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.323501 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.323646 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.325130 (+ 1484us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.325204 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.325381 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8870,"thread_start_us":8771,"threads_started":1}
I20260811 06:50:22.329274 25878 tablet_service.cc:1467] Processing CreateTablet for tablet 249171883a7a44658540b4ee628a832e (DEFAULT_TABLE table=test-table [id=d734312d790b40e6bfc24ec91a9f4250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:22.331238 25878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 249171883a7a44658540b4ee628a832e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:22.334537 26539 tablet_bootstrap.cc:492] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: Bootstrap starting.
I20260811 06:50:22.338387 26539 tablet_bootstrap.cc:654] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:22.338706 26540 tablet_bootstrap.cc:492] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: Bootstrap starting.
I20260811 06:50:22.339926 26539 log.cc:824] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:22.342396 26540 tablet_bootstrap.cc:654] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:22.343525 26539 tablet_bootstrap.cc:492] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: No bootstrap required, opened a new log
I20260811 06:50:22.343717 26540 log.cc:824] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:22.343827 26539 ts_tablet_manager.cc:1397] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.005s
I20260811 06:50:22.346899 26540 tablet_bootstrap.cc:492] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: No bootstrap required, opened a new log
I20260811 06:50:22.347211 26540 ts_tablet_manager.cc:1397] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 06:50:22.351871 26544 tablet_bootstrap.cc:492] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: Bootstrap starting.
I20260811 06:50:22.354110 26539 raft_consensus.cc:348] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } }
I20260811 06:50:22.354732 26539 raft_consensus.cc:374] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:22.354875 26539 raft_consensus.cc:729] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cf5397059e46779e9a25fd46fe7f83, State: Initialized, Role: FOLLOWER
I20260811 06:50:22.354979 26544 tablet_bootstrap.cc:654] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:22.355655 26539 consensus_queue.cc:260] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } }
I20260811 06:50:22.356513 26544 log.cc:824] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:22.357553 26539 ts_tablet_manager.cc:1428] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260811 06:50:22.357573 26540 raft_consensus.cc:348] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } }
I20260811 06:50:22.358002 26540 raft_consensus.cc:374] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:22.358114 26540 raft_consensus.cc:729] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38de9892de5e4b6b95444ea3d2ac938b, State: Initialized, Role: FOLLOWER
I20260811 06:50:22.358875 26540 consensus_queue.cc:260] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } }
I20260811 06:50:22.360671 26540 ts_tablet_manager.cc:1428] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260811 06:50:22.361994 26544 tablet_bootstrap.cc:492] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: No bootstrap required, opened a new log
I20260811 06:50:22.362267 26544 ts_tablet_manager.cc:1397] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260811 06:50:22.370201 26544 raft_consensus.cc:348] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } }
I20260811 06:50:22.370604 26544 raft_consensus.cc:374] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:22.370699 26544 raft_consensus.cc:729] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 485b74e6b3ba4899bfce4b9fb1956eef, State: Initialized, Role: FOLLOWER
I20260811 06:50:22.371249 26544 consensus_queue.cc:260] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } }
I20260811 06:50:22.372668 26544 ts_tablet_manager.cc:1428] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: Time spent starting tablet: real 0.010s user 0.006s sys 0.005s
I20260811 06:50:22.436600 26550 raft_consensus.cc:482] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:50:22.436933 26550 raft_consensus.cc:504] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } }
I20260811 06:50:22.438876 26550 leader_election.cc:288] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441), 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281)
I20260811 06:50:22.447386 26530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.439372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:52319 (local address 127.12.145.3:43441)
0811 06:50:22.439588 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.439593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.440160 (+ 567us) server_negotiation.cc:407] Connection header received
0811 06:50:22.440408 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.440414 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.440504 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.440614 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:22.441286 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.442309 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.445016 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.446278 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.446450 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.446537 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.446982 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.447119 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:50:22.447379 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.440444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:50711 (local address 127.12.145.2:35281)
0811 06:50:22.440647 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.440653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.440926 (+ 273us) server_negotiation.cc:407] Connection header received
0811 06:50:22.441092 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.441095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.441153 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.441236 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:22.441709 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.442638 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.445033 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.446333 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.446462 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.446536 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.447006 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.447133 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 06:50:22.447561 26553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.440196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:35281 (local address 127.12.145.1:50711)
0811 06:50:22.440818 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:22.440836 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:22.440969 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:22.441263 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:22.441267 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:22.441286 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:22.441565 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.441573 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.442786 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.442792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.444838 (+ 2046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.444862 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.446579 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.446584 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.446773 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.446847 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 06:50:22.446942 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 06:50:22.447103 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":40,"thread_start_us":296,"threads_started":1}
I20260811 06:50:22.447824 26552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.439330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:43441 (local address 127.12.145.1:52319)
0811 06:50:22.440060 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:22.440081 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:22.440233 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:22.440716 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:22.440721 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:22.440748 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:22.441147 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.441157 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.442463 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.442467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.444847 (+ 2380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.444858 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.446563 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.446572 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.446779 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.446852 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 06:50:22.446945 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 06:50:22.447103 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"mutex_wait_us":103,"thread_start_us":382,"threads_started":1}
I20260811 06:50:22.448839 26402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249171883a7a44658540b4ee628a832e" candidate_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38de9892de5e4b6b95444ea3d2ac938b" is_pre_election: true
I20260811 06:50:22.448809 26153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249171883a7a44658540b4ee628a832e" candidate_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cf5397059e46779e9a25fd46fe7f83" is_pre_election: true
I20260811 06:50:22.449471 26153 raft_consensus.cc:2454] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 485b74e6b3ba4899bfce4b9fb1956eef in term 0.
I20260811 06:50:22.449471 26402 raft_consensus.cc:2454] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 485b74e6b3ba4899bfce4b9fb1956eef in term 0.
I20260811 06:50:22.450165 25786 leader_election.cc:302] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 485b74e6b3ba4899bfce4b9fb1956eef, 69cf5397059e46779e9a25fd46fe7f83; no voters:
I20260811 06:50:22.450604 26550 raft_consensus.cc:2781] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:50:22.450748 26550 raft_consensus.cc:482] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:50:22.450852 26550 raft_consensus.cc:3037] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:22.453143 26550 raft_consensus.cc:504] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } }
I20260811 06:50:22.453761 26550 leader_election.cc:288] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [CANDIDATE]: Term 1 election: Requested vote from peers 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441), 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281)
I20260811 06:50:22.454200 26402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249171883a7a44658540b4ee628a832e" candidate_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38de9892de5e4b6b95444ea3d2ac938b"
I20260811 06:50:22.454293 26153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249171883a7a44658540b4ee628a832e" candidate_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cf5397059e46779e9a25fd46fe7f83"
I20260811 06:50:22.454388 26402 raft_consensus.cc:3037] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:22.454514 26153 raft_consensus.cc:3037] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:22.456713 26153 raft_consensus.cc:2454] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 485b74e6b3ba4899bfce4b9fb1956eef in term 1.
I20260811 06:50:22.456713 26402 raft_consensus.cc:2454] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 485b74e6b3ba4899bfce4b9fb1956eef in term 1.
I20260811 06:50:22.457115 25786 leader_election.cc:302] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 485b74e6b3ba4899bfce4b9fb1956eef, 69cf5397059e46779e9a25fd46fe7f83; no voters:
I20260811 06:50:22.457391 26550 raft_consensus.cc:2781] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:22.457842 26550 raft_consensus.cc:686] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 LEADER]: Becoming Leader. State: Replica: 485b74e6b3ba4899bfce4b9fb1956eef, State: Running, Role: LEADER
I20260811 06:50:22.458328 26550 consensus_queue.cc:237] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } }
I20260811 06:50:22.463256 25615 catalog_manager.cc:5495] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1). New cstate: current_term: 1 leader_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } health_report { overall_health: HEALTHY } } }
I20260811 06:50:22.485025 26538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.479874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34334 (local address 127.12.145.1:44093)
0811 06:50:22.480054 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.480059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.480165 (+ 106us) server_negotiation.cc:407] Connection header received
0811 06:50:22.480343 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.480347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.480437 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.480572 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:50:22.480835 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.481572 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.482812 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.483333 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.483462 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.483954 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:50:22.484544 (+ 590us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:50:22.484651 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.484729 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.484799 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 06:50:22.493269 26153 raft_consensus.cc:1261] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Refusing update from remote peer 485b74e6b3ba4899bfce4b9fb1956eef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:22.493307 26402 raft_consensus.cc:1261] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Refusing update from remote peer 485b74e6b3ba4899bfce4b9fb1956eef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:22.494253 26555 consensus_queue.cc:1035] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:22.494645 26550 consensus_queue.cc:1035] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:22.505921 26564 mvcc.cc:205] Tried to move back new op lower bound from 7317221468122714112 to 7317221467992883200. Current Snapshot: MvccSnapshot[applied={T|T < 7317221468122714112}]
I20260811 06:50:22.523275 25613 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:50:22.523566 25613 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:50:22.527444 25613 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655: Sending DeleteTablet for 3 replicas of tablet 249171883a7a44658540b4ee628a832e
I20260811 06:50:22.528846 25878 tablet_service.cc:1514] Processing DeleteTablet for tablet 249171883a7a44658540b4ee628a832e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:22 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:34322
I20260811 06:50:22.528936 26111 tablet_service.cc:1514] Processing DeleteTablet for tablet 249171883a7a44658540b4ee628a832e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:22 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:34990
I20260811 06:50:22.530920 26372 tablet_service.cc:1514] Processing DeleteTablet for tablet 249171883a7a44658540b4ee628a832e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:22 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:48328
I20260811 06:50:22.531330 26587 tablet_replica.cc:330] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: stopping tablet replica
I20260811 06:50:22.532003 26587 raft_consensus.cc:2229] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:50:22.531890 25613 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:50:22.532671 25613 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:50:22.533149 26587 raft_consensus.cc:2258] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:22.535368 26587 ts_tablet_manager.cc:1905] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:22.547022 25878 tablet_service.cc:1467] Processing CreateTablet for tablet e07ba5b953264a26bc5534eb60bb3a50 (DEFAULT_TABLE table=test-table [id=d44b6b450e364d59a81055cfc1a6c7d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:22.547328 26587 ts_tablet_manager.cc:1918] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:50:22.547420 26371 tablet_service.cc:1467] Processing CreateTablet for tablet e07ba5b953264a26bc5534eb60bb3a50 (DEFAULT_TABLE table=test-table [id=d44b6b450e364d59a81055cfc1a6c7d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:22.547560 25878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e07ba5b953264a26bc5534eb60bb3a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:22.547720 26587 log.cc:1196] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/249171883a7a44658540b4ee628a832e
I20260811 06:50:22.548007 26371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e07ba5b953264a26bc5534eb60bb3a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:22.548507 26587 ts_tablet_manager.cc:1939] T 249171883a7a44658540b4ee628a832e P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting consensus metadata
I20260811 06:50:22.548633 26590 tablet_replica.cc:330] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: stopping tablet replica
I20260811 06:50:22.549160 26590 raft_consensus.cc:2229] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:50:22.549736 26590 raft_consensus.cc:2258] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:22.551036 26110 tablet_service.cc:1467] Processing CreateTablet for tablet e07ba5b953264a26bc5534eb60bb3a50 (DEFAULT_TABLE table=test-table [id=d44b6b450e364d59a81055cfc1a6c7d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:22.551554 26110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e07ba5b953264a26bc5534eb60bb3a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:22.554021 25590 catalog_manager.cc:4841] TS 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093): tablet 249171883a7a44658540b4ee628a832e (table test-table [id=d734312d790b40e6bfc24ec91a9f4250]) successfully deleted
I20260811 06:50:22.555846 26544 tablet_bootstrap.cc:492] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef: Bootstrap starting.
I20260811 06:50:22.557607 26544 tablet_bootstrap.cc:654] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:22.557909 26539 tablet_bootstrap.cc:492] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83: Bootstrap starting.
I20260811 06:50:22.559530 26539 tablet_bootstrap.cc:654] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:22.559782 26590 ts_tablet_manager.cc:1905] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:22.563967 26540 tablet_bootstrap.cc:492] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: Bootstrap starting.
I20260811 06:50:22.565649 26540 tablet_bootstrap.cc:654] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:22.571802 26539 tablet_bootstrap.cc:492] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83: No bootstrap required, opened a new log
I20260811 06:50:22.572039 26539 ts_tablet_manager.cc:1397] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.006s
I20260811 06:50:22.572999 26539 raft_consensus.cc:348] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.573329 26539 raft_consensus.cc:374] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:22.573349 26590 ts_tablet_manager.cc:1918] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:50:22.573556 26539 raft_consensus.cc:729] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cf5397059e46779e9a25fd46fe7f83, State: Initialized, Role: FOLLOWER
I20260811 06:50:22.574049 26539 consensus_queue.cc:260] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.576323 26544 tablet_bootstrap.cc:492] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef: No bootstrap required, opened a new log
I20260811 06:50:22.576503 26544 ts_tablet_manager.cc:1397] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.007s
I20260811 06:50:22.577312 26590 log.cc:1196] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/249171883a7a44658540b4ee628a832e
I20260811 06:50:22.577406 26544 raft_consensus.cc:348] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.577687 26544 raft_consensus.cc:374] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:22.577795 26544 raft_consensus.cc:729] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 485b74e6b3ba4899bfce4b9fb1956eef, State: Initialized, Role: FOLLOWER
I20260811 06:50:22.577839 26539 ts_tablet_manager.cc:1428] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260811 06:50:22.578087 26544 consensus_queue.cc:260] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.579918 26544 ts_tablet_manager.cc:1428] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:50:22.580623 26588 tablet_replica.cc:330] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: stopping tablet replica
I20260811 06:50:22.581089 26588 raft_consensus.cc:2229] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:50:22.581255 26590 ts_tablet_manager.cc:1939] T 249171883a7a44658540b4ee628a832e P 38de9892de5e4b6b95444ea3d2ac938b: Deleting consensus metadata
I20260811 06:50:22.581717 26588 raft_consensus.cc:2258] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:22.583811 26588 ts_tablet_manager.cc:1905] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:22.584005 26540 tablet_bootstrap.cc:492] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: No bootstrap required, opened a new log
I20260811 06:50:22.584152 26540 ts_tablet_manager.cc:1397] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.009s
I20260811 06:50:22.584847 26540 raft_consensus.cc:348] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.585029 26540 raft_consensus.cc:374] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:22.585127 26540 raft_consensus.cc:729] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38de9892de5e4b6b95444ea3d2ac938b, State: Initialized, Role: FOLLOWER
I20260811 06:50:22.585429 26540 consensus_queue.cc:260] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.585996 26540 ts_tablet_manager.cc:1428] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:50:22.586971 25590 catalog_manager.cc:4841] TS 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441): tablet 249171883a7a44658540b4ee628a832e (table test-table [id=d734312d790b40e6bfc24ec91a9f4250]) successfully deleted
I20260811 06:50:22.591081 26588 ts_tablet_manager.cc:1918] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:50:22.591259 26588 log.cc:1196] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/249171883a7a44658540b4ee628a832e
I20260811 06:50:22.591799 26588 ts_tablet_manager.cc:1939] T 249171883a7a44658540b4ee628a832e P 69cf5397059e46779e9a25fd46fe7f83: Deleting consensus metadata
I20260811 06:50:22.592233 26546 raft_consensus.cc:482] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:50:22.592408 26546 raft_consensus.cc:504] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.593673 25590 catalog_manager.cc:4841] TS 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281): tablet 249171883a7a44658540b4ee628a832e (table test-table [id=d734312d790b40e6bfc24ec91a9f4250]) successfully deleted
I20260811 06:50:22.594105 26546 leader_election.cc:288] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093), 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441)
I20260811 06:50:22.602746 26595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.594307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44093 (local address 127.12.145.2:60293)
0811 06:50:22.594809 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:22.594830 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:22.594957 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:22.595576 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:22.595581 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:22.595611 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:22.595999 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.596011 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.597713 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.597719 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.600013 (+ 2294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.600031 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.601921 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.601928 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.602115 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.602151 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 06:50:22.602251 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 06:50:22.602399 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":438,"threads_started":1}
I20260811 06:50:22.602785 26538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.594684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:60293 (local address 127.12.145.1:44093)
0811 06:50:22.594884 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.594891 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.594914 (+ 23us) server_negotiation.cc:407] Connection header received
0811 06:50:22.595133 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.595145 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.595252 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.595329 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:22.596190 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.597457 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.600200 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.601471 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.601705 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.601783 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.602313 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.602456 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 06:50:22.603830 25912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e07ba5b953264a26bc5534eb60bb3a50" candidate_uuid: "69cf5397059e46779e9a25fd46fe7f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" is_pre_election: true
I20260811 06:50:22.604362 25912 raft_consensus.cc:2454] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69cf5397059e46779e9a25fd46fe7f83 in term 0.
I20260811 06:50:22.605079 26031 leader_election.cc:302] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 485b74e6b3ba4899bfce4b9fb1956eef, 69cf5397059e46779e9a25fd46fe7f83; no voters:
I20260811 06:50:22.605583 26546 raft_consensus.cc:2781] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:50:22.605710 26546 raft_consensus.cc:482] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:50:22.605800 26546 raft_consensus.cc:3037] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:22.607321 26530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.595302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:55127 (local address 127.12.145.3:43441)
0811 06:50:22.595464 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.595481 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.600715 (+ 5234us) server_negotiation.cc:407] Connection header received
0811 06:50:22.600865 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.600870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.600950 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.601041 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:22.601696 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.602797 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.604981 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.606115 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.606276 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.606347 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.606917 (+ 570us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.607052 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:50:22.608016 26598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.595123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:43441 (local address 127.12.145.2:55127)
0811 06:50:22.600595 (+ 5472us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:22.600615 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:22.600748 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:22.601077 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:22.601081 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:22.601109 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:22.601479 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.601492 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.602961 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.602966 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.604840 (+ 1874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.604866 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.606520 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.606530 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.606720 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.606753 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 06:50:22.607558 (+ 805us) client_negotiation.cc:240] Negotiation successful
0811 06:50:22.607688 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5334,"thread_start_us":5154,"threads_started":1}
I20260811 06:50:22.608732 26402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e07ba5b953264a26bc5534eb60bb3a50" candidate_uuid: "69cf5397059e46779e9a25fd46fe7f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38de9892de5e4b6b95444ea3d2ac938b" is_pre_election: true
W20260811 06:50:22.608815 26498 tablet.cc:2369] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:50:22.608954 26402 raft_consensus.cc:2454] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69cf5397059e46779e9a25fd46fe7f83 in term 0.
I20260811 06:50:22.609742 26546 raft_consensus.cc:504] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.610349 26546 leader_election.cc:288] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [CANDIDATE]: Term 1 election: Requested vote from peers 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093), 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441)
I20260811 06:50:22.610872 25912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e07ba5b953264a26bc5534eb60bb3a50" candidate_uuid: "69cf5397059e46779e9a25fd46fe7f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "485b74e6b3ba4899bfce4b9fb1956eef"
I20260811 06:50:22.610971 26402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e07ba5b953264a26bc5534eb60bb3a50" candidate_uuid: "69cf5397059e46779e9a25fd46fe7f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38de9892de5e4b6b95444ea3d2ac938b"
I20260811 06:50:22.611114 25912 raft_consensus.cc:3037] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:22.611156 26402 raft_consensus.cc:3037] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:22.614084 26402 raft_consensus.cc:2454] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69cf5397059e46779e9a25fd46fe7f83 in term 1.
I20260811 06:50:22.614349 25912 raft_consensus.cc:2454] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69cf5397059e46779e9a25fd46fe7f83 in term 1.
I20260811 06:50:22.614586 26031 leader_election.cc:302] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38de9892de5e4b6b95444ea3d2ac938b, 69cf5397059e46779e9a25fd46fe7f83; no voters:
I20260811 06:50:22.614863 26546 raft_consensus.cc:2781] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:22.615337 26546 raft_consensus.cc:686] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 LEADER]: Becoming Leader. State: Replica: 69cf5397059e46779e9a25fd46fe7f83, State: Running, Role: LEADER
I20260811 06:50:22.615757 26546 consensus_queue.cc:237] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.619280 25611 catalog_manager.cc:5495] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2). New cstate: current_term: 1 leader_uuid: "69cf5397059e46779e9a25fd46fe7f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } health_report { overall_health: UNKNOWN } } }
Aug 11 06:50:22 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431019, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.62@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:50:22.690371 26611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.676320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36875 (local address 127.0.0.1:40558)
0811 06:50:22.676936 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:22.676952 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:22.677102 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:22.677429 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:22.677434 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:22.678214 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:22.678504 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.678516 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.679546 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.679551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.680520 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.680533 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.681258 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.681265 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.681426 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.682195 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:22.682214 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:22.684817 (+ 2603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:22.687791 (+ 2974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:22.687805 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:22.687815 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:22.688231 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:22.688567 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:22.688573 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:22.688577 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:22.688717 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:22.689235 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:22.689243 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:22.689426 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 06:50:22.689601 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 06:50:22.689885 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":359,"threads_started":1}
I20260811 06:50:22.690387 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.676233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40558 (local address 127.12.145.62:36875)
0811 06:50:22.676446 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.676451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.677046 (+ 595us) server_negotiation.cc:407] Connection header received
0811 06:50:22.677215 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.677220 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.677284 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.677365 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:22.678652 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.679408 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.680656 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.681074 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.681183 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.685013 (+ 3830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:22.685019 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:22.685022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:22.685053 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:22.687664 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:22.688343 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:22.688348 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:22.688350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:22.688467 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:22.688815 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:22.688820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:22.688823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:22.689103 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:22.689254 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.689694 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.690032 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":126,"server-negotiator.queue_time_us":95}
I20260811 06:50:22.695399 25611 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:40558:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 06:50:22.696471 25611 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:50:22.703742 26111 tablet_service.cc:1467] Processing CreateTablet for tablet a865ef6767c24776b95a761db86e2149 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e4b23d54817d43b2b9bbb2cf48a5f8bc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 06:50:22.703856 25878 tablet_service.cc:1467] Processing CreateTablet for tablet a865ef6767c24776b95a761db86e2149 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e4b23d54817d43b2b9bbb2cf48a5f8bc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 06:50:22.704241 26111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a865ef6767c24776b95a761db86e2149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:22.704457 25878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a865ef6767c24776b95a761db86e2149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:22.710572 26539 tablet_bootstrap.cc:492] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: Bootstrap starting.
I20260811 06:50:22.710523 26371 tablet_service.cc:1467] Processing CreateTablet for tablet a865ef6767c24776b95a761db86e2149 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e4b23d54817d43b2b9bbb2cf48a5f8bc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 06:50:22.711114 26371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a865ef6767c24776b95a761db86e2149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:22.712294 26539 tablet_bootstrap.cc:654] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:22.713017 26544 tablet_bootstrap.cc:492] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: Bootstrap starting.
I20260811 06:50:22.714813 26544 tablet_bootstrap.cc:654] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:22.718644 26540 tablet_bootstrap.cc:492] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: Bootstrap starting.
I20260811 06:50:22.720381 26540 tablet_bootstrap.cc:654] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:22.725330 26544 tablet_bootstrap.cc:492] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: No bootstrap required, opened a new log
I20260811 06:50:22.725603 26544 ts_tablet_manager.cc:1397] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260811 06:50:22.726434 26544 raft_consensus.cc:348] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.726792 26544 raft_consensus.cc:374] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:22.726922 26544 raft_consensus.cc:729] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 485b74e6b3ba4899bfce4b9fb1956eef, State: Initialized, Role: FOLLOWER
I20260811 06:50:22.727269 26544 consensus_queue.cc:260] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.727840 26550 tablet_replica.cc:439] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } }
I20260811 06:50:22.728120 26550 tablet_replica.cc:442] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:50:22.729504 26539 tablet_bootstrap.cc:492] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: No bootstrap required, opened a new log
I20260811 06:50:22.729698 26539 ts_tablet_manager.cc:1397] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.010s
I20260811 06:50:22.730175 26540 tablet_bootstrap.cc:492] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: No bootstrap required, opened a new log
I20260811 06:50:22.730336 26540 ts_tablet_manager.cc:1397] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260811 06:50:22.730993 26539 raft_consensus.cc:348] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.731047 26540 raft_consensus.cc:348] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.731252 26540 raft_consensus.cc:374] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:22.731245 26539 raft_consensus.cc:374] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:22.731319 26539 raft_consensus.cc:729] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cf5397059e46779e9a25fd46fe7f83, State: Initialized, Role: FOLLOWER
I20260811 06:50:22.731319 26540 raft_consensus.cc:729] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38de9892de5e4b6b95444ea3d2ac938b, State: Initialized, Role: FOLLOWER
I20260811 06:50:22.731564 26539 consensus_queue.cc:260] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.731644 26540 consensus_queue.cc:260] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.731976 26544 ts_tablet_manager.cc:1428] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:50:22.732012 26546 tablet_replica.cc:439] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } }
I20260811 06:50:22.732048 26549 tablet_replica.cc:439] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } }
I20260811 06:50:22.732314 26546 tablet_replica.cc:442] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:50:22.732373 26549 tablet_replica.cc:442] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:50:22.732772 26540 ts_tablet_manager.cc:1428] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:50:22.733716 26539 ts_tablet_manager.cc:1428] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260811 06:50:22.788717 26002 tablet.cc:2369] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:50:22.822899 26244 tablet.cc:2369] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:50:22.825095 26546 raft_consensus.cc:482] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:50:22.825294 26546 raft_consensus.cc:504] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.825917 26546 leader_election.cc:288] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093), 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441)
I20260811 06:50:22.826578 25912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a865ef6767c24776b95a761db86e2149" candidate_uuid: "69cf5397059e46779e9a25fd46fe7f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" is_pre_election: true
I20260811 06:50:22.826656 26402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a865ef6767c24776b95a761db86e2149" candidate_uuid: "69cf5397059e46779e9a25fd46fe7f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38de9892de5e4b6b95444ea3d2ac938b" is_pre_election: true
I20260811 06:50:22.826892 26402 raft_consensus.cc:2454] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69cf5397059e46779e9a25fd46fe7f83 in term 0.
I20260811 06:50:22.826910 25912 raft_consensus.cc:2454] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69cf5397059e46779e9a25fd46fe7f83 in term 0.
I20260811 06:50:22.827363 26031 leader_election.cc:302] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38de9892de5e4b6b95444ea3d2ac938b, 69cf5397059e46779e9a25fd46fe7f83; no voters:
I20260811 06:50:22.827656 26546 raft_consensus.cc:2781] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:50:22.827781 26546 raft_consensus.cc:482] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:50:22.827992 26546 raft_consensus.cc:3037] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:22.831295 26546 raft_consensus.cc:504] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.831992 26546 leader_election.cc:288] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [CANDIDATE]: Term 1 election: Requested vote from peers 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093), 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441)
I20260811 06:50:22.832468 26402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a865ef6767c24776b95a761db86e2149" candidate_uuid: "69cf5397059e46779e9a25fd46fe7f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38de9892de5e4b6b95444ea3d2ac938b"
I20260811 06:50:22.832497 25912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a865ef6767c24776b95a761db86e2149" candidate_uuid: "69cf5397059e46779e9a25fd46fe7f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "485b74e6b3ba4899bfce4b9fb1956eef"
I20260811 06:50:22.832682 26402 raft_consensus.cc:3037] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:22.832760 25912 raft_consensus.cc:3037] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:22.834838 26402 raft_consensus.cc:2454] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69cf5397059e46779e9a25fd46fe7f83 in term 1.
I20260811 06:50:22.835238 26031 leader_election.cc:302] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38de9892de5e4b6b95444ea3d2ac938b, 69cf5397059e46779e9a25fd46fe7f83; no voters:
I20260811 06:50:22.835508 26546 raft_consensus.cc:2781] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:22.835657 26546 raft_consensus.cc:686] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 LEADER]: Becoming Leader. State: Replica: 69cf5397059e46779e9a25fd46fe7f83, State: Running, Role: LEADER
I20260811 06:50:22.835897 26546 consensus_queue.cc:237] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:22.836050 25912 raft_consensus.cc:2454] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69cf5397059e46779e9a25fd46fe7f83 in term 1.
I20260811 06:50:22.837689 26599 tablet_replica.cc:439] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: TxnStatusTablet state changed. Reason: New leader 69cf5397059e46779e9a25fd46fe7f83. Latest consensus state: current_term: 1 leader_uuid: "69cf5397059e46779e9a25fd46fe7f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } }
I20260811 06:50:22.838146 26599 tablet_replica.cc:442] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: This TxnStatusTablet replica's current role is: LEADER
I20260811 06:50:22.838861 26621 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 06:50:22.839098 26621 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 06:50:22.840197 25615 catalog_manager.cc:5495] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2). New cstate: current_term: 1 leader_uuid: "69cf5397059e46779e9a25fd46fe7f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } health_report { overall_health: UNKNOWN } } }
I20260811 06:50:22.857764 26611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.851978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:35281 (local address 127.0.0.1:35002)
0811 06:50:22.852198 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:22.852219 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:22.852364 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:22.852910 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:22.852915 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:22.852928 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:50:22.853106 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.853115 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.854209 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.854214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.855317 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.855330 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.856089 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.856095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.856292 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.856348 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:50:22.857167 (+ 819us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:50:22.857189 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 06:50:22.857261 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 06:50:22.857416 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 06:50:22.857764 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.852380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35002 (local address 127.12.145.2:35281)
0811 06:50:22.852551 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.852556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.852573 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:50:22.852645 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.852649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.852746 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.852865 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:50:22.853233 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.854076 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.855459 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.855927 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.856059 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.856532 (+ 473us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:50:22.857061 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:50:22.857188 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.857293 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.857386 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:50:22.862195 26402 raft_consensus.cc:1261] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Refusing update from remote peer 69cf5397059e46779e9a25fd46fe7f83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:22.862432 25912 raft_consensus.cc:1261] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Refusing update from remote peer 69cf5397059e46779e9a25fd46fe7f83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:22.863104 26546 consensus_queue.cc:1035] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:22.863919 26546 consensus_queue.cc:1035] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:22.877146 26550 tablet_replica.cc:439] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: TxnStatusTablet state changed. Reason: New leader 69cf5397059e46779e9a25fd46fe7f83. Latest consensus state: current_term: 1 leader_uuid: "69cf5397059e46779e9a25fd46fe7f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } }
I20260811 06:50:22.877507 26550 tablet_replica.cc:442] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:50:22.878860 26549 tablet_replica.cc:439] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: TxnStatusTablet state changed. Reason: New leader 69cf5397059e46779e9a25fd46fe7f83. Latest consensus state: current_term: 1 leader_uuid: "69cf5397059e46779e9a25fd46fe7f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } }
I20260811 06:50:22.879158 26549 tablet_replica.cc:442] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:50:22.879189 26546 tablet_replica.cc:439] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "69cf5397059e46779e9a25fd46fe7f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } }
I20260811 06:50:22.879447 26546 tablet_replica.cc:442] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: This TxnStatusTablet replica's current role is: LEADER
I20260811 06:50:22.879638 26561 mvcc.cc:205] Tried to move back new op lower bound from 7317221469635706880 to 7317221469538529280. Current Snapshot: MvccSnapshot[applied={T|T < 7317221469635706880}]
I20260811 06:50:22.883175 26599 tablet_replica.cc:439] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "69cf5397059e46779e9a25fd46fe7f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } }
I20260811 06:50:22.883421 26599 tablet_replica.cc:442] T a865ef6767c24776b95a761db86e2149 P 69cf5397059e46779e9a25fd46fe7f83: This TxnStatusTablet replica's current role is: LEADER
I20260811 06:50:22.884833 26560 mvcc.cc:205] Tried to move back new op lower bound from 7317221469635706880 to 7317221469538529280. Current Snapshot: MvccSnapshot[applied={T|T < 7317221469635706880}]
I20260811 06:50:22.885147 26550 tablet_replica.cc:439] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "69cf5397059e46779e9a25fd46fe7f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } }
I20260811 06:50:22.885406 26550 tablet_replica.cc:442] T a865ef6767c24776b95a761db86e2149 P 485b74e6b3ba4899bfce4b9fb1956eef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:50:22.889395 26549 tablet_replica.cc:439] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "69cf5397059e46779e9a25fd46fe7f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } } }
I20260811 06:50:22.889667 26549 tablet_replica.cc:442] T a865ef6767c24776b95a761db86e2149 P 38de9892de5e4b6b95444ea3d2ac938b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 06:50:22.898758 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.889703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35018 (local address 127.12.145.2:35281)
0811 06:50:22.889868 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.889875 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.889892 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:50:22.889965 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.889970 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.890050 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.890136 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:50:22.890782 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.891870 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.895533 (+ 3663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.896285 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.896419 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.897555 (+ 1136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:50:22.897730 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:50:22.897831 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.898342 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.898436 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:50:22.919147 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.911348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:33155 (local address 127.12.145.2:35281)
0811 06:50:22.911544 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:22.911550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:22.912289 (+ 739us) server_negotiation.cc:407] Connection header received
0811 06:50:22.912522 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:22.912527 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:22.912613 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:22.912702 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:50:22.913400 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.914621 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.916802 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.917493 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.917637 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.918190 (+ 553us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:50:22.918354 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:50:22.918502 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:22.918723 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 06:50:22.918815 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":59}
I20260811 06:50:22.919516 26633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:22.911382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:35281 (local address 127.12.145.2:33155)
0811 06:50:22.912163 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:22.912184 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:22.912357 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:22.912753 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:22.912758 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:22.912771 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:50:22.913228 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.913242 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.914768 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.914774 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.916643 (+ 1869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:22.916660 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:22.917730 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:22.917737 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:22.917932 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:22.918008 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:50:22.918549 (+ 541us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:50:22.918558 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 06:50:22.918636 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 06:50:22.918778 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"mutex_wait_us":27,"thread_start_us":402,"threads_started":1}
I20260811 06:50:22.930914 26401 raft_consensus.cc:1261] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Refusing update from remote peer 69cf5397059e46779e9a25fd46fe7f83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:22.931713 26599 consensus_queue.cc:1035] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:22.933773 25910 raft_consensus.cc:1261] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Refusing update from remote peer 69cf5397059e46779e9a25fd46fe7f83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:22.935065 26599 consensus_queue.cc:1035] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:23.033910 25615 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:50:23.034212 25615 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:50:23.037791 25615 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655: Sending DeleteTablet for 3 replicas of tablet e07ba5b953264a26bc5534eb60bb3a50
I20260811 06:50:23.039033 26111 tablet_service.cc:1514] Processing DeleteTablet for tablet e07ba5b953264a26bc5534eb60bb3a50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:23 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:34990
I20260811 06:50:23.039144 26371 tablet_service.cc:1514] Processing DeleteTablet for tablet e07ba5b953264a26bc5534eb60bb3a50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:23 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:48328
I20260811 06:50:23.039315 26588 tablet_replica.cc:330] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83: stopping tablet replica
I20260811 06:50:23.039364 25878 tablet_service.cc:1514] Processing DeleteTablet for tablet e07ba5b953264a26bc5534eb60bb3a50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:23 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:34322
I20260811 06:50:23.039427 26590 tablet_replica.cc:330] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: stopping tablet replica
I20260811 06:50:23.039523 26588 raft_consensus.cc:2229] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:50:23.039623 26590 raft_consensus.cc:2229] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:50:23.039817 26590 raft_consensus.cc:2258] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:23.040060 26588 raft_consensus.cc:2258] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:23.040086 26587 tablet_replica.cc:330] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef: stopping tablet replica
I20260811 06:50:23.040270 26587 raft_consensus.cc:2229] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:50:23.040478 26587 raft_consensus.cc:2258] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:23.041884 26588 ts_tablet_manager.cc:1905] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:23.041884 26590 ts_tablet_manager.cc:1905] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:23.047617 26587 ts_tablet_manager.cc:1905] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:23.049077 26588 ts_tablet_manager.cc:1918] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:50:23.049142 26590 ts_tablet_manager.cc:1918] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:50:23.049249 26588 log.cc:1196] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/e07ba5b953264a26bc5534eb60bb3a50
I20260811 06:50:23.049463 26590 log.cc:1196] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/e07ba5b953264a26bc5534eb60bb3a50
I20260811 06:50:23.049711 26588 ts_tablet_manager.cc:1939] T e07ba5b953264a26bc5534eb60bb3a50 P 69cf5397059e46779e9a25fd46fe7f83: Deleting consensus metadata
I20260811 06:50:23.050078 26590 ts_tablet_manager.cc:1939] T e07ba5b953264a26bc5534eb60bb3a50 P 38de9892de5e4b6b95444ea3d2ac938b: Deleting consensus metadata
I20260811 06:50:23.051321 25590 catalog_manager.cc:4841] TS 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441): tablet e07ba5b953264a26bc5534eb60bb3a50 (table test-table [id=d44b6b450e364d59a81055cfc1a6c7d2]) successfully deleted
I20260811 06:50:23.055279 25590 catalog_manager.cc:4841] TS 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281): tablet e07ba5b953264a26bc5534eb60bb3a50 (table test-table [id=d44b6b450e364d59a81055cfc1a6c7d2]) successfully deleted
I20260811 06:50:23.069237 26587 ts_tablet_manager.cc:1918] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:50:23.069475 26587 log.cc:1196] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/e07ba5b953264a26bc5534eb60bb3a50
I20260811 06:50:23.069962 26587 ts_tablet_manager.cc:1939] T e07ba5b953264a26bc5534eb60bb3a50 P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting consensus metadata
I20260811 06:50:23.071194 25590 catalog_manager.cc:4841] TS 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093): tablet e07ba5b953264a26bc5534eb60bb3a50 (table test-table [id=d44b6b450e364d59a81055cfc1a6c7d2]) successfully deleted
Aug 11 06:50:23 dist-test-slave-7lbf krb5kdc[25538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 06:50:23 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:23 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 06:50:23.124636 25799 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:23.109897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40568 (local address 127.12.145.62:36875)
0811 06:50:23.110105 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:23.110111 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:23.111150 (+ 1039us) server_negotiation.cc:407] Connection header received
0811 06:50:23.111329 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:23.111335 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:23.111423 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:23.111534 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:23.113264 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.114561 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.116422 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.117154 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.117320 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.124308 (+ 6988us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40568: BlockingRecv error: recv got EOF from 127.0.0.1:40568 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 06:50:23 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM
I20260811 06:50:23.153023 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.137779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40572 (local address 127.12.145.62:36875)
0811 06:50:23.137991 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:23.137997 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:23.138367 (+ 370us) server_negotiation.cc:407] Connection header received
0811 06:50:23.138594 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:23.138621 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:23.138716 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:23.138834 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:23.140241 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.141105 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.142567 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.143053 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.143187 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.147557 (+ 4370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:23.147563 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:23.147567 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:23.147605 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:23.150270 (+ 2665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:23.151006 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:23.151010 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:23.151013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:23.151166 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:23.151545 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:23.151548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:23.151551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:23.151848 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:23.152073 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:23.152441 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 06:50:23.152680 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 06:50:23.156627 25615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:50:23.157215 25615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:50:23.164289 25878 tablet_service.cc:1467] Processing CreateTablet for tablet 981d42daf51d4fbcadefc1d8f6c004d8 (DEFAULT_TABLE table=test-table [id=33fc2124ac5c4227916c274c3b8af506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:23.164647 26111 tablet_service.cc:1467] Processing CreateTablet for tablet 981d42daf51d4fbcadefc1d8f6c004d8 (DEFAULT_TABLE table=test-table [id=33fc2124ac5c4227916c274c3b8af506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:23.164778 25878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 981d42daf51d4fbcadefc1d8f6c004d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:23.164685 26371 tablet_service.cc:1467] Processing CreateTablet for tablet 981d42daf51d4fbcadefc1d8f6c004d8 (DEFAULT_TABLE table=test-table [id=33fc2124ac5c4227916c274c3b8af506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:23.165129 26111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 981d42daf51d4fbcadefc1d8f6c004d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:23.165131 26371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 981d42daf51d4fbcadefc1d8f6c004d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:23.171599 26544 tablet_bootstrap.cc:492] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef: Bootstrap starting.
I20260811 06:50:23.171959 26540 tablet_bootstrap.cc:492] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b: Bootstrap starting.
I20260811 06:50:23.172240 26539 tablet_bootstrap.cc:492] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83: Bootstrap starting.
I20260811 06:50:23.173326 26544 tablet_bootstrap.cc:654] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:23.173439 26540 tablet_bootstrap.cc:654] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:23.174001 26539 tablet_bootstrap.cc:654] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:23.184955 26544 tablet_bootstrap.cc:492] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef: No bootstrap required, opened a new log
I20260811 06:50:23.185246 26544 ts_tablet_manager.cc:1397] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.008s
I20260811 06:50:23.185297 26539 tablet_bootstrap.cc:492] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83: No bootstrap required, opened a new log
I20260811 06:50:23.185563 26539 ts_tablet_manager.cc:1397] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260811 06:50:23.186276 26544 raft_consensus.cc:348] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.186672 26544 raft_consensus.cc:374] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:23.186815 26544 raft_consensus.cc:729] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 485b74e6b3ba4899bfce4b9fb1956eef, State: Initialized, Role: FOLLOWER
I20260811 06:50:23.186655 26539 raft_consensus.cc:348] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.187103 26539 raft_consensus.cc:374] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:23.187261 26539 raft_consensus.cc:729] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cf5397059e46779e9a25fd46fe7f83, State: Initialized, Role: FOLLOWER
I20260811 06:50:23.187135 26544 consensus_queue.cc:260] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.187604 26539 consensus_queue.cc:260] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.188346 26540 tablet_bootstrap.cc:492] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b: No bootstrap required, opened a new log
I20260811 06:50:23.188575 26540 ts_tablet_manager.cc:1397] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.000s
I20260811 06:50:23.188386 26539 ts_tablet_manager.cc:1428] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:50:23.190239 26544 ts_tablet_manager.cc:1428] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 06:50:23.190451 26540 raft_consensus.cc:348] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.190817 26540 raft_consensus.cc:374] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:23.190972 26540 raft_consensus.cc:729] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38de9892de5e4b6b95444ea3d2ac938b, State: Initialized, Role: FOLLOWER
I20260811 06:50:23.191287 26540 consensus_queue.cc:260] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.191903 26540 ts_tablet_manager.cc:1428] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:50:23.211041 26549 raft_consensus.cc:482] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:50:23.211298 26549 raft_consensus.cc:504] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.213384 26549 leader_election.cc:288] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093), 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281)
I20260811 06:50:23.221088 26673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.213672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:47109 (local address 127.12.145.1:44093)
0811 06:50:23.214927 (+ 1255us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:23.214934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:23.214955 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:50:23.215026 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:23.215032 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:23.215124 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:23.215827 (+ 703us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:23.215993 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.217038 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.219107 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.220038 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.220206 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.220289 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:23.220622 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 06:50:23.220774 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1119,"thread_start_us":1214,"threads_started":1}
I20260811 06:50:23.221132 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.213550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44093 (local address 127.12.145.3:47109)
0811 06:50:23.214136 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:23.214163 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:23.214322 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:23.215329 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:23.215334 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:23.215366 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:23.215633 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:23.215647 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.217192 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.217197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:23.218923 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:23.218937 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.220239 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.220246 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:23.220441 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.220480 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 06:50:23.220586 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 06:50:23.220731 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":42,"thread_start_us":291,"threads_started":1}
I20260811 06:50:23.222306 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.214672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:33457 (local address 127.12.145.2:35281)
0811 06:50:23.214865 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:23.214871 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:23.215536 (+ 665us) server_negotiation.cc:407] Connection header received
0811 06:50:23.215683 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:23.215687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:23.215766 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:23.215836 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:23.216368 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.217154 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.219803 (+ 2649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.221026 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.221205 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.221286 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:23.221883 (+ 597us) server_negotiation.cc:299] Negotiation successful
0811 06:50:23.222035 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 06:50:23.222194 25908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "981d42daf51d4fbcadefc1d8f6c004d8" candidate_uuid: "38de9892de5e4b6b95444ea3d2ac938b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" is_pre_election: true
I20260811 06:50:23.222494 25908 raft_consensus.cc:2454] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38de9892de5e4b6b95444ea3d2ac938b in term 0.
I20260811 06:50:23.223047 26674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.214315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:35281 (local address 127.12.145.3:33457)
0811 06:50:23.215424 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:23.215438 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:23.215563 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:23.215875 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:23.215879 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:23.215904 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:23.216221 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:23.216230 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.217302 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.217316 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:23.219616 (+ 2300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:23.219634 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.221475 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.221481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:23.221683 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.221718 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 06:50:23.222506 (+ 788us) client_negotiation.cc:240] Negotiation successful
0811 06:50:23.222647 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1014,"mutex_wait_us":1,"thread_start_us":816,"threads_started":1}
I20260811 06:50:23.223264 26282 leader_election.cc:302] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38de9892de5e4b6b95444ea3d2ac938b, 485b74e6b3ba4899bfce4b9fb1956eef; no voters:
I20260811 06:50:23.223699 26549 raft_consensus.cc:2781] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:50:23.223829 26549 raft_consensus.cc:482] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:50:23.223938 26549 raft_consensus.cc:3037] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:23.224146 26153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "981d42daf51d4fbcadefc1d8f6c004d8" candidate_uuid: "38de9892de5e4b6b95444ea3d2ac938b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cf5397059e46779e9a25fd46fe7f83" is_pre_election: true
I20260811 06:50:23.224388 26153 raft_consensus.cc:2454] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38de9892de5e4b6b95444ea3d2ac938b in term 0.
I20260811 06:50:23.227267 26549 raft_consensus.cc:504] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.228024 26549 leader_election.cc:288] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [CANDIDATE]: Term 1 election: Requested vote from peers 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093), 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281)
I20260811 06:50:23.228490 25908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "981d42daf51d4fbcadefc1d8f6c004d8" candidate_uuid: "38de9892de5e4b6b95444ea3d2ac938b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "485b74e6b3ba4899bfce4b9fb1956eef"
I20260811 06:50:23.228528 26153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "981d42daf51d4fbcadefc1d8f6c004d8" candidate_uuid: "38de9892de5e4b6b95444ea3d2ac938b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cf5397059e46779e9a25fd46fe7f83"
I20260811 06:50:23.228708 25908 raft_consensus.cc:3037] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:23.228713 26153 raft_consensus.cc:3037] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:23.231053 26153 raft_consensus.cc:2454] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38de9892de5e4b6b95444ea3d2ac938b in term 1.
I20260811 06:50:23.231449 26282 leader_election.cc:302] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38de9892de5e4b6b95444ea3d2ac938b, 69cf5397059e46779e9a25fd46fe7f83; no voters:
I20260811 06:50:23.231741 26549 raft_consensus.cc:2781] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:23.231777 25908 raft_consensus.cc:2454] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38de9892de5e4b6b95444ea3d2ac938b in term 1.
I20260811 06:50:23.232254 26549 raft_consensus.cc:686] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 LEADER]: Becoming Leader. State: Replica: 38de9892de5e4b6b95444ea3d2ac938b, State: Running, Role: LEADER
I20260811 06:50:23.232730 26549 consensus_queue.cc:237] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.236379 25615 catalog_manager.cc:5495] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b reported cstate change: term changed from 0 to 1, leader changed from <none> to 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3). New cstate: current_term: 1 leader_uuid: "38de9892de5e4b6b95444ea3d2ac938b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } health_report { overall_health: HEALTHY } } }
I20260811 06:50:23.259044 26680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.252461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48342 (local address 127.12.145.3:43441)
0811 06:50:23.253481 (+ 1020us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:23.253486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:23.253504 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:50:23.253623 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:23.253627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:23.253706 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:23.253866 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:50:23.254304 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.255202 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.256649 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.257082 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.257196 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.257716 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:50:23.258360 (+ 644us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:50:23.258501 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:23.258618 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 06:50:23.258705 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":905,"thread_start_us":758,"threads_started":1}
I20260811 06:50:23.263288 25908 raft_consensus.cc:1261] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Refusing update from remote peer 38de9892de5e4b6b95444ea3d2ac938b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:23.263353 26153 raft_consensus.cc:1261] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Refusing update from remote peer 38de9892de5e4b6b95444ea3d2ac938b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:23.264120 26676 consensus_queue.cc:1035] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [LEADER]: Connected to new peer: Peer: permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:23.264569 26549 consensus_queue.cc:1035] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [LEADER]: Connected to new peer: Peer: permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:23.285616 25615 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:50:23.285887 25615 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:50:23.289098 25615 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655: Sending DeleteTablet for 3 replicas of tablet 981d42daf51d4fbcadefc1d8f6c004d8
I20260811 06:50:23.289989 25878 tablet_service.cc:1514] Processing DeleteTablet for tablet 981d42daf51d4fbcadefc1d8f6c004d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:23 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:34322
I20260811 06:50:23.290338 26587 tablet_replica.cc:330] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef: stopping tablet replica
I20260811 06:50:23.290575 26111 tablet_service.cc:1514] Processing DeleteTablet for tablet 981d42daf51d4fbcadefc1d8f6c004d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:23 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:34990
I20260811 06:50:23.290925 26588 tablet_replica.cc:330] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83: stopping tablet replica
I20260811 06:50:23.291036 26587 raft_consensus.cc:2229] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:50:23.291115 26588 raft_consensus.cc:2229] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:50:23.291306 26587 raft_consensus.cc:2258] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:23.291363 26588 raft_consensus.cc:2258] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:23.292337 26371 tablet_service.cc:1514] Processing DeleteTablet for tablet 981d42daf51d4fbcadefc1d8f6c004d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:23 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:48328
I20260811 06:50:23.292524 26588 ts_tablet_manager.cc:1905] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:23.292706 26590 tablet_replica.cc:330] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b: stopping tablet replica
I20260811 06:50:23.292887 26590 raft_consensus.cc:2229] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:50:23.294229 26587 ts_tablet_manager.cc:1905] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:23.299106 26590 raft_consensus.cc:2258] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:23.299799 26588 ts_tablet_manager.cc:1918] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:50:23.299959 26588 log.cc:1196] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/981d42daf51d4fbcadefc1d8f6c004d8
I20260811 06:50:23.300426 26588 ts_tablet_manager.cc:1939] T 981d42daf51d4fbcadefc1d8f6c004d8 P 69cf5397059e46779e9a25fd46fe7f83: Deleting consensus metadata
I20260811 06:50:23.300410 26590 ts_tablet_manager.cc:1905] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:23.305372 26587 ts_tablet_manager.cc:1918] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:50:23.305723 25590 catalog_manager.cc:4841] TS 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281): tablet 981d42daf51d4fbcadefc1d8f6c004d8 (table test-table [id=33fc2124ac5c4227916c274c3b8af506]) successfully deleted
I20260811 06:50:23.305939 25615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:50:23.306700 25615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:50:23.308856 26587 log.cc:1196] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/981d42daf51d4fbcadefc1d8f6c004d8
I20260811 06:50:23.309381 26587 ts_tablet_manager.cc:1939] T 981d42daf51d4fbcadefc1d8f6c004d8 P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting consensus metadata
I20260811 06:50:23.310660 25590 catalog_manager.cc:4841] TS 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093): tablet 981d42daf51d4fbcadefc1d8f6c004d8 (table test-table [id=33fc2124ac5c4227916c274c3b8af506]) successfully deleted
I20260811 06:50:23.315176 25878 tablet_service.cc:1467] Processing CreateTablet for tablet f8b8ecf8e1464c4d8f9472b92f15bae5 (DEFAULT_TABLE table=test-table [id=20354ba2bff7457ebb5d16b2b8e963e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:23.315675 25878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8b8ecf8e1464c4d8f9472b92f15bae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:23.315662 26111 tablet_service.cc:1467] Processing CreateTablet for tablet f8b8ecf8e1464c4d8f9472b92f15bae5 (DEFAULT_TABLE table=test-table [id=20354ba2bff7457ebb5d16b2b8e963e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:23.316119 26111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8b8ecf8e1464c4d8f9472b92f15bae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:23.318300 26371 tablet_service.cc:1467] Processing CreateTablet for tablet f8b8ecf8e1464c4d8f9472b92f15bae5 (DEFAULT_TABLE table=test-table [id=20354ba2bff7457ebb5d16b2b8e963e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:23.318744 26371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8b8ecf8e1464c4d8f9472b92f15bae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:23.322216 26544 tablet_bootstrap.cc:492] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef: Bootstrap starting.
I20260811 06:50:23.323874 26544 tablet_bootstrap.cc:654] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:23.326104 26544 tablet_bootstrap.cc:492] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef: No bootstrap required, opened a new log
I20260811 06:50:23.326267 26544 ts_tablet_manager.cc:1397] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260811 06:50:23.327013 26544 raft_consensus.cc:348] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.327273 26544 raft_consensus.cc:374] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:23.327359 26544 raft_consensus.cc:729] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 485b74e6b3ba4899bfce4b9fb1956eef, State: Initialized, Role: FOLLOWER
I20260811 06:50:23.327658 26544 consensus_queue.cc:260] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.328259 26544 ts_tablet_manager.cc:1428] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:50:23.329944 26540 tablet_bootstrap.cc:492] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b: Bootstrap starting.
I20260811 06:50:23.331805 26540 tablet_bootstrap.cc:654] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:23.335008 26539 tablet_bootstrap.cc:492] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83: Bootstrap starting.
I20260811 06:50:23.336912 26539 tablet_bootstrap.cc:654] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:23.308599 26590 ts_tablet_manager.cc:1918] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:50:23.338486 26590 log.cc:1196] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/981d42daf51d4fbcadefc1d8f6c004d8
I20260811 06:50:23.339183 26590 ts_tablet_manager.cc:1939] T 981d42daf51d4fbcadefc1d8f6c004d8 P 38de9892de5e4b6b95444ea3d2ac938b: Deleting consensus metadata
I20260811 06:50:23.340137 25590 catalog_manager.cc:4841] TS 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441): tablet 981d42daf51d4fbcadefc1d8f6c004d8 (table test-table [id=33fc2124ac5c4227916c274c3b8af506]) successfully deleted
I20260811 06:50:23.342720 26540 tablet_bootstrap.cc:492] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b: No bootstrap required, opened a new log
I20260811 06:50:23.342913 26540 ts_tablet_manager.cc:1397] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.001s
I20260811 06:50:23.343852 26540 raft_consensus.cc:348] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.344193 26540 raft_consensus.cc:374] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:23.344288 26540 raft_consensus.cc:729] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38de9892de5e4b6b95444ea3d2ac938b, State: Initialized, Role: FOLLOWER
I20260811 06:50:23.344601 26540 consensus_queue.cc:260] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.345906 26540 ts_tablet_manager.cc:1428] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 06:50:23.346714 26539 tablet_bootstrap.cc:492] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83: No bootstrap required, opened a new log
I20260811 06:50:23.346911 26539 ts_tablet_manager.cc:1397] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20260811 06:50:23.349864 26539 raft_consensus.cc:348] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.350188 26539 raft_consensus.cc:374] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:23.350286 26539 raft_consensus.cc:729] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cf5397059e46779e9a25fd46fe7f83, State: Initialized, Role: FOLLOWER
I20260811 06:50:23.350569 26539 consensus_queue.cc:260] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.351171 26539 ts_tablet_manager.cc:1428] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260811 06:50:23.439110 26550 raft_consensus.cc:482] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:50:23.439347 26550 raft_consensus.cc:504] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.440142 26550 leader_election.cc:288] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281), 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441)
I20260811 06:50:23.440830 26402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b8ecf8e1464c4d8f9472b92f15bae5" candidate_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38de9892de5e4b6b95444ea3d2ac938b" is_pre_election: true
I20260811 06:50:23.441043 26153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b8ecf8e1464c4d8f9472b92f15bae5" candidate_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cf5397059e46779e9a25fd46fe7f83" is_pre_election: true
I20260811 06:50:23.441136 26402 raft_consensus.cc:2454] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 485b74e6b3ba4899bfce4b9fb1956eef in term 0.
I20260811 06:50:23.441316 26153 raft_consensus.cc:2454] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 485b74e6b3ba4899bfce4b9fb1956eef in term 0.
I20260811 06:50:23.441659 25786 leader_election.cc:302] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38de9892de5e4b6b95444ea3d2ac938b, 485b74e6b3ba4899bfce4b9fb1956eef; no voters:
I20260811 06:50:23.441987 26550 raft_consensus.cc:2781] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:50:23.442112 26550 raft_consensus.cc:482] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:50:23.442198 26550 raft_consensus.cc:3037] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:23.445487 26550 raft_consensus.cc:504] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.446871 26153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b8ecf8e1464c4d8f9472b92f15bae5" candidate_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69cf5397059e46779e9a25fd46fe7f83"
I20260811 06:50:23.447033 26402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8b8ecf8e1464c4d8f9472b92f15bae5" candidate_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38de9892de5e4b6b95444ea3d2ac938b"
I20260811 06:50:23.447171 26153 raft_consensus.cc:3037] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:23.447304 26402 raft_consensus.cc:3037] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:23.450569 26402 raft_consensus.cc:2454] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 485b74e6b3ba4899bfce4b9fb1956eef in term 1.
I20260811 06:50:23.450585 26153 raft_consensus.cc:2454] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 485b74e6b3ba4899bfce4b9fb1956eef in term 1.
I20260811 06:50:23.446305 26550 leader_election.cc:288] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [CANDIDATE]: Term 1 election: Requested vote from peers 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281), 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441)
I20260811 06:50:23.451301 25786 leader_election.cc:302] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 485b74e6b3ba4899bfce4b9fb1956eef, 69cf5397059e46779e9a25fd46fe7f83; no voters:
I20260811 06:50:23.451674 26550 raft_consensus.cc:2781] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:23.452198 26550 raft_consensus.cc:686] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 LEADER]: Becoming Leader. State: Replica: 485b74e6b3ba4899bfce4b9fb1956eef, State: Running, Role: LEADER
I20260811 06:50:23.452538 26550 consensus_queue.cc:237] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } }
I20260811 06:50:23.457268 25613 catalog_manager.cc:5495] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1). New cstate: current_term: 1 leader_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "485b74e6b3ba4899bfce4b9fb1956eef" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 } health_report { overall_health: UNKNOWN } } }
I20260811 06:50:23.506633 26673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.500333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34342 (local address 127.12.145.1:44093)
0811 06:50:23.500531 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:23.500537 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:23.500779 (+ 242us) server_negotiation.cc:407] Connection header received
0811 06:50:23.500849 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:23.500855 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:23.500949 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:23.501035 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:50:23.501483 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.502586 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.504575 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.505218 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.505343 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.505893 (+ 550us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:50:23.506027 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:50:23.506122 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:23.506266 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 06:50:23.506354 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 06:50:23.528748 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.517690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:53291 (local address 127.12.145.2:35281)
0811 06:50:23.517900 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:23.517906 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:23.522161 (+ 4255us) server_negotiation.cc:407] Connection header received
0811 06:50:23.522454 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:23.522461 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:23.522560 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:23.522663 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:50:23.523236 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.524422 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.526529 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.527225 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.527355 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.527903 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:50:23.528070 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:50:23.528159 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:23.528303 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 06:50:23.528395 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 06:50:23.528823 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.517676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:35281 (local address 127.12.145.1:53291)
0811 06:50:23.522051 (+ 4375us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:23.522073 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:23.522290 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:23.522692 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:23.522697 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:23.522709 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:50:23.523057 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:23.523069 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.524571 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.524577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:23.526385 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:23.526403 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.527418 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.527425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:23.527605 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.527691 (+ 86us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:50:23.528172 (+ 481us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:50:23.528185 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 06:50:23.528269 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 06:50:23.528424 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4173,"thread_start_us":4013,"threads_started":1}
I20260811 06:50:23.541495 26402 raft_consensus.cc:1261] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Refusing update from remote peer 485b74e6b3ba4899bfce4b9fb1956eef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:23.541783 26153 raft_consensus.cc:1261] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Refusing update from remote peer 485b74e6b3ba4899bfce4b9fb1956eef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:23.542223 26550 consensus_queue.cc:1035] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "38de9892de5e4b6b95444ea3d2ac938b" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 43441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:23.542950 26550 consensus_queue.cc:1035] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "69cf5397059e46779e9a25fd46fe7f83" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:23.632403 26712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.602581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44093 (local address 127.12.145.2:60393)
0811 06:50:23.612735 (+ 10154us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:23.612756 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:23.613075 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:23.613681 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:23.613687 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:23.613701 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 06:50:23.613986 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:23.613997 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.615675 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.615681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:23.617357 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:23.617398 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.630893 (+ 13495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.630902 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:23.631129 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.631183 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 06:50:23.631682 (+ 499us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 06:50:23.631694 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 06:50:23.631767 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 06:50:23.631954 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9996,"thread_start_us":10280,"threads_started":1}
I20260811 06:50:23.633582 26673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.602878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:60393 (local address 127.12.145.1:44093)
0811 06:50:23.603049 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:23.603055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:23.612840 (+ 9785us) server_negotiation.cc:407] Connection header received
0811 06:50:23.613262 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:23.613268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:23.613368 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:23.613447 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:50:23.614202 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.615483 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.629669 (+ 14186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.630344 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.630709 (+ 365us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.631383 (+ 674us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:50:23.631532 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:50:23.631626 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:23.633152 (+ 1526us) server_negotiation.cc:299] Negotiation successful
0811 06:50:23.633241 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 06:50:23.679143 25613 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:50:23.679445 25613 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:50:23.683270 25613 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9323fbc1b6714196a58ce31f3f466655: Sending DeleteTablet for 3 replicas of tablet f8b8ecf8e1464c4d8f9472b92f15bae5
I20260811 06:50:23.684345 26371 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b8ecf8e1464c4d8f9472b92f15bae5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:23 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:48328
I20260811 06:50:23.684697 26590 tablet_replica.cc:330] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b: stopping tablet replica
I20260811 06:50:23.684917 26590 raft_consensus.cc:2229] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:50:23.685141 26590 raft_consensus.cc:2258] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:23.685349 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 25761
I20260811 06:50:23.686844 25878 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b8ecf8e1464c4d8f9472b92f15bae5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:23 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:34322
I20260811 06:50:23.687160 26590 ts_tablet_manager.cc:1905] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:23.687233 26587 tablet_replica.cc:330] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef: stopping tablet replica
I20260811 06:50:23.687448 26587 raft_consensus.cc:2229] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:50:23.687788 26587 raft_consensus.cc:2258] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:23.688472 26111 tablet_service.cc:1514] Processing DeleteTablet for tablet f8b8ecf8e1464c4d8f9472b92f15bae5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:23 UTC) from {username='oryx', principal='oryx/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:34990
I20260811 06:50:23.689864 26588 tablet_replica.cc:330] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83: stopping tablet replica
I20260811 06:50:23.690083 26588 raft_consensus.cc:2229] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:50:23.690281 26588 raft_consensus.cc:2258] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:23.692181 26588 ts_tablet_manager.cc:1905] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:23.694254 26587 ts_tablet_manager.cc:1905] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:23.695806 26590 ts_tablet_manager.cc:1918] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:50:23.695971 26590 log.cc:1196] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/f8b8ecf8e1464c4d8f9472b92f15bae5
I20260811 06:50:23.696393 26590 ts_tablet_manager.cc:1939] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 38de9892de5e4b6b95444ea3d2ac938b: Deleting consensus metadata
I20260811 06:50:23.697682 25590 catalog_manager.cc:4841] TS 38de9892de5e4b6b95444ea3d2ac938b (127.12.145.3:43441): tablet f8b8ecf8e1464c4d8f9472b92f15bae5 (table test-table [id=20354ba2bff7457ebb5d16b2b8e963e5]) successfully deleted
I20260811 06:50:23.704627 26587 ts_tablet_manager.cc:1918] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:50:23.708019 26588 ts_tablet_manager.cc:1918] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 06:50:23.708411 26587 log.cc:1196] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/f8b8ecf8e1464c4d8f9472b92f15bae5
I20260811 06:50:23.708930 26587 ts_tablet_manager.cc:1939] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 485b74e6b3ba4899bfce4b9fb1956eef: Deleting consensus metadata
Aug 11 06:50:23 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.1@KRBTEST.COM
I20260811 06:50:23.709187 26588 log.cc:1196] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/f8b8ecf8e1464c4d8f9472b92f15bae5
I20260811 06:50:23.710639 25590 catalog_manager.cc:4841] TS 485b74e6b3ba4899bfce4b9fb1956eef (127.12.145.1:44093): tablet f8b8ecf8e1464c4d8f9472b92f15bae5 (table test-table [id=20354ba2bff7457ebb5d16b2b8e963e5]) successfully deleted
I20260811 06:50:23.711395 26588 ts_tablet_manager.cc:1939] T f8b8ecf8e1464c4d8f9472b92f15bae5 P 69cf5397059e46779e9a25fd46fe7f83: Deleting consensus metadata
I20260811 06:50:23.712705 25590 catalog_manager.cc:4841] TS 69cf5397059e46779e9a25fd46fe7f83 (127.12.145.2:35281): tablet f8b8ecf8e1464c4d8f9472b92f15bae5 (table test-table [id=20354ba2bff7457ebb5d16b2b8e963e5]) successfully deleted
I20260811 06:50:23.717754 26673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.688834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34344 (local address 127.12.145.1:44093)
0811 06:50:23.689144 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:23.689150 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:23.698189 (+ 9039us) server_negotiation.cc:407] Connection header received
0811 06:50:23.698712 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:23.698717 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:23.698814 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:23.698892 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:23.700918 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.702064 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.703921 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.704563 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.704673 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.710272 (+ 5599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:23.710294 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:23.710317 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:23.710360 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:23.714350 (+ 3990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:23.715316 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:23.715327 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:23.715331 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:23.715505 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:23.715945 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:23.715950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:23.715954 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:23.716480 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:23.716787 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:23.717108 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 06:50:23.717377 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260811 06:50:23.718583 25990 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:23.907673 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 25761
I20260811 06:50:23.940459 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 26006
Aug 11 06:50:23 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.2@KRBTEST.COM
I20260811 06:50:23.955189 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:23.941308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35026 (local address 127.12.145.2:35281)
0811 06:50:23.941509 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:23.941531 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:23.941551 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:50:23.941614 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:23.941617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:23.941679 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:23.941781 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:23.942889 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.943562 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.944819 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:23.945260 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:23.945350 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:23.949717 (+ 4367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:23.949737 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:23.949760 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:23.949801 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:23.952605 (+ 2804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:23.953251 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:23.953258 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:23.953260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:23.953382 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:23.953795 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:23.953798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:23.953800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:23.954152 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:23.954463 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:23.954749 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 06:50:23.954922 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 06:50:23.955904 26235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:24.100059 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 26006
I20260811 06:50:24.144078 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 26250
Aug 11 06:50:24 dist-test-slave-7lbf krb5kdc[25538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.3@KRBTEST.COM
I20260811 06:50:24.159498 26721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:24.144810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48344 (local address 127.12.145.3:43441)
0811 06:50:24.145652 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:24.145656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:24.145675 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:50:24.145728 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:24.145731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:24.145793 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:24.145894 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:24.147186 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:24.147875 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:24.149087 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:24.149485 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:24.149752 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:24.154027 (+ 4275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:24.154042 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:24.154058 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:24.154097 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:24.156831 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:24.157470 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:24.157477 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:24.157480 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:24.157663 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:24.158016 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:24.158021 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:24.158025 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:24.158371 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:24.158638 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:24.158950 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 06:50:24.159182 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":557,"threads_started":1}
I20260811 06:50:24.160156 26486 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:24.281211 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 26250
I20260811 06:50:24.308435 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 25560
I20260811 06:50:24.309731 25694 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:24.425110 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 25560
2026-08-11T06:50:24Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6980 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:50:24 dist-test-slave-7lbf krb5kdc[26727](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:50:24 dist-test-slave-7lbf krb5kdc[26727](info): set up 2 sockets
Aug 11 06:50:24 dist-test-slave-7lbf krb5kdc[26727](info): commencing operation
krb5kdc: starting...
W20260811 06:50:25.674136 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.009s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:50:25 dist-test-slave-7lbf krb5kdc[26727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:50:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:50:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:50:25.935145 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35725
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:35725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:26.265390 26751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:26.265720 26751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:26.265873 26751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:26.272998 26751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:50:26.273128 26751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:26.273211 26751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:26.273288 26751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:50:26.273355 26751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:50:26.283110 26751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:35725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:26.284412 26751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:26.285755 26751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:26.297874 26760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:26.297910 26761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:26.297932 26763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:26.298573 26751 server_base.cc:1034] running on GCE node
I20260811 06:50:26.299364 26751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:26.300761 26751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:26.301973 26751 hybrid_clock.cc:648] HybridClock initialized: now 1786431026301904 us; error 56 us; skew 500 ppm
I20260811 06:50:26.302330 26751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T06:50:26Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1944 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:50:26 dist-test-slave-7lbf krb5kdc[26774](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:50:26 dist-test-slave-7lbf krb5kdc[26774](info): set up 2 sockets
Aug 11 06:50:26 dist-test-slave-7lbf krb5kdc[26774](info): commencing operation
krb5kdc: starting...
W20260811 06:50:27.630430 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:50:27 dist-test-slave-7lbf krb5kdc[26774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:50:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:50:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:50:27.890241 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:40415
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:38973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:40415
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:28.221689 26795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:28.222038 26795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:28.222180 26795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:28.229470 26795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:50:28.229619 26795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:28.229701 26795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:28.229781 26795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:50:28.229851 26795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:50:28.239953 26795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:38973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:40415
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:40415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:28.241350 26795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:28.242695 26795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:28.254346 26808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:28.254410 26814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:28.254387 26812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:28.255441 26795 server_base.cc:1034] running on GCE node
I20260811 06:50:28.256271 26795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:28.257681 26795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:28.258920 26795 hybrid_clock.cc:648] HybridClock initialized: now 1786431028258872 us; error 35 us; skew 500 ppm
I20260811 06:50:28.259272 26795 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:28 dist-test-slave-7lbf krb5kdc[26774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:28.265328 26795 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:50:28.266948 26795 webserver.cc:460] Webserver started at http://127.12.145.62:46021/ using document root <none> and password file <none>
I20260811 06:50:28.267644 26795 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:28.267759 26795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:28.268090 26795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:28.271207 26795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a"
format_stamp: "Formatted at 2026-08-11 06:50:28 on dist-test-slave-7lbf"
server_key: "fb9e4e560071f4055324e55d1121cebd"
server_key_iv: "5807a19ce5f9433b9dd8649b298e6329"
server_key_version: "encryptionkey@0"
I20260811 06:50:28.271960 26795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a"
format_stamp: "Formatted at 2026-08-11 06:50:28 on dist-test-slave-7lbf"
server_key: "fb9e4e560071f4055324e55d1121cebd"
server_key_iv: "5807a19ce5f9433b9dd8649b298e6329"
server_key_version: "encryptionkey@0"
I20260811 06:50:28.277196 26795 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260811 06:50:28.280668 26825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:28.282035 26795 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 06:50:28.282202 26795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a"
format_stamp: "Formatted at 2026-08-11 06:50:28 on dist-test-slave-7lbf"
server_key: "fb9e4e560071f4055324e55d1121cebd"
server_key_iv: "5807a19ce5f9433b9dd8649b298e6329"
server_key_version: "encryptionkey@0"
I20260811 06:50:28.282397 26795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:28.297206 26795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:28.301258 26795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:28.301578 26795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:28.319398 26795 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:40415
I20260811 06:50:28.319406 26905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:40415 every 8 connection(s)
I20260811 06:50:28.320899 26795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:50:28.323958 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 26795
I20260811 06:50:28.324211 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:50:28.325031 12868 external_mini_cluster.cc:1428] Setting key d1b4647c2a5bde2f790ecf773b0be497
I20260811 06:50:28.325246 26906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:28.340226 26906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a: Bootstrap starting.
Aug 11 06:50:28 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:50:28.343762 26906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:28.344867 26906 log.cc:824] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:28.347715 26906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a: No bootstrap required, opened a new log
I20260811 06:50:28.348939 26913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:28.327235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53402 (local address 127.12.145.62:40415)
0811 06:50:28.328020 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:28.328032 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:28.328088 (+ 56us) server_negotiation.cc:407] Connection header received
0811 06:50:28.330166 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:28.330189 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:28.330634 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:28.330980 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:28.332890 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:28.334245 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:28.336025 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:28.336790 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:28.336935 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:28.341620 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:28.341630 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:28.341649 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:28.341703 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:28.344786 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:28.345557 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:28.345567 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:28.345576 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:28.345762 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:28.346142 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:28.346146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:28.346148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:28.346702 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:28.346989 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:28.347499 (+ 510us) server_negotiation.cc:299] Negotiation successful
0811 06:50:28.347943 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":349,"threads_started":1}
I20260811 06:50:28.355679 26906 raft_consensus.cc:348] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } }
I20260811 06:50:28.356065 26906 raft_consensus.cc:374] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:28.356165 26906 raft_consensus.cc:729] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299b0eb92e3b4aa5ac3148f6a24fd40a, State: Initialized, Role: FOLLOWER
I20260811 06:50:28.356751 26906 consensus_queue.cc:260] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } }
I20260811 06:50:28.357002 26906 raft_consensus.cc:388] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:50:28.357131 26906 raft_consensus.cc:482] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:50:28.357293 26906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:28.359531 26906 raft_consensus.cc:504] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } }
I20260811 06:50:28.359997 26906 leader_election.cc:302] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 299b0eb92e3b4aa5ac3148f6a24fd40a; no voters:
I20260811 06:50:28.360546 26906 leader_election.cc:288] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:50:28.360661 26917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:28.361299 26917 raft_consensus.cc:686] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 1 LEADER]: Becoming Leader. State: Replica: 299b0eb92e3b4aa5ac3148f6a24fd40a, State: Running, Role: LEADER
I20260811 06:50:28.361914 26917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } }
I20260811 06:50:28.362756 26906 sys_catalog.cc:564] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:50:28.364650 26918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } } }
I20260811 06:50:28.365453 26918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:28.365095 26920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 299b0eb92e3b4aa5ac3148f6a24fd40a. Latest consensus state: current_term: 1 leader_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } } }
I20260811 06:50:28.366236 26920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:28.374929 26932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:50:28.380667 26932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:50:28.389326 26932 catalog_manager.cc:1347] Generated new cluster ID: 67d073ce25cb41acafc1b767af6d48cb
I20260811 06:50:28.389453 26932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:50:28.398746 26932 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:50:28.400211 26932 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:50:28.408382 26932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a: Generated new TSK 0
I20260811 06:50:28.409611 26932 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:50:28.483420 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:40415
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:38973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:28.817716 26957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:28.817999 26957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:28.818120 26957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:28.825275 26957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:28.825412 26957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:28.825594 26957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:50:28.835270 26957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:38973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:40415
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:28.836568 26957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:28.837908 26957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:28.851132 26971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:28.851052 26974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:28.851033 26972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:28.852082 26957 server_base.cc:1034] running on GCE node
I20260811 06:50:28.852679 26957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:28.853660 26957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:28.854962 26957 hybrid_clock.cc:648] HybridClock initialized: now 1786431028854907 us; error 37 us; skew 500 ppm
I20260811 06:50:28.855297 26957 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:28 dist-test-slave-7lbf krb5kdc[26774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:28.858371 26957 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:50:28.859788 26957 webserver.cc:460] Webserver started at http://127.12.145.1:39717/ using document root <none> and password file <none>
I20260811 06:50:28.860446 26957 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:28.860544 26957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:28.860814 26957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:28.863739 26957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "ba7d5ef6ffcc49c4921b59375cbd645d"
format_stamp: "Formatted at 2026-08-11 06:50:28 on dist-test-slave-7lbf"
server_key: "417e0c6f72d243c4840730285b1890c4"
server_key_iv: "aa9beedc1fcdac774eb4cab53ea6720b"
server_key_version: "encryptionkey@0"
I20260811 06:50:28.864526 26957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "ba7d5ef6ffcc49c4921b59375cbd645d"
format_stamp: "Formatted at 2026-08-11 06:50:28 on dist-test-slave-7lbf"
server_key: "417e0c6f72d243c4840730285b1890c4"
server_key_iv: "aa9beedc1fcdac774eb4cab53ea6720b"
server_key_version: "encryptionkey@0"
I20260811 06:50:28.869848 26957 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 06:50:28.873221 26982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:28.874598 26957 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:50:28.874752 26957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "ba7d5ef6ffcc49c4921b59375cbd645d"
format_stamp: "Formatted at 2026-08-11 06:50:28 on dist-test-slave-7lbf"
server_key: "417e0c6f72d243c4840730285b1890c4"
server_key_iv: "aa9beedc1fcdac774eb4cab53ea6720b"
server_key_version: "encryptionkey@0"
I20260811 06:50:28.874948 26957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:28.894500 26957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:28.898455 26957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:28.898748 26957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:28.899706 26957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:28.901099 26957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:28.901171 26957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:28.901291 26957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:28.901342 26957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:28.934175 26957 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:34353
I20260811 06:50:28.934219 27193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:34353 every 8 connection(s)
I20260811 06:50:28.935421 26957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:50:28.941588 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 26957
I20260811 06:50:28.941831 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:50:28.942624 12868 external_mini_cluster.cc:1428] Setting key 6b54264558f869eeae2d1a027132baee
Aug 11 06:50:28 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:50:28.956108 27201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:28.937880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:50493 (local address 127.12.145.62:40415)
0811 06:50:28.938359 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:28.938365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:28.939294 (+ 929us) server_negotiation.cc:407] Connection header received
0811 06:50:28.941153 (+ 1859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:28.941157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:28.941229 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:28.941322 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:28.943439 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:28.944429 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:28.946554 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:28.946952 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:28.947052 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:28.950742 (+ 3690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:28.950748 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:28.950751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:28.950782 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:28.953130 (+ 2348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:28.953878 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:28.953882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:28.953885 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:28.954011 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:28.954421 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:28.954425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:28.954427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:28.954691 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:28.954826 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:28.955513 (+ 687us) server_negotiation.cc:299] Negotiation successful
0811 06:50:28.955737 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":216,"threads_started":1}
I20260811 06:50:28.957013 27203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:28.938438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:50493)
0811 06:50:28.939129 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:28.939175 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:28.940900 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:28.941649 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:28.941661 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:28.942447 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:28.943248 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:28.943276 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:28.944579 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:28.944582 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:28.946416 (+ 1834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:28.946433 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:28.947179 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:28.947185 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:28.947450 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:28.948121 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:28.948155 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:28.950521 (+ 2366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:28.953260 (+ 2739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:28.953269 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:28.953285 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:28.953757 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:28.954116 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:28.954121 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:28.954124 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:28.954304 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:28.954817 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:28.954825 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:28.955142 (+ 317us) client_negotiation.cc:769] Sending connection context
0811 06:50:28.955377 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 06:50:28.955899 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":258,"threads_started":1}
I20260811 06:50:28.958575 27194 heartbeater.cc:347] Connected to a master server at 127.12.145.62:40415
I20260811 06:50:28.958891 27194 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:28.959800 27194 heartbeater.cc:511] Master 127.12.145.62:40415 requested a full tablet report, sending...
I20260811 06:50:28.962124 26850 ts_manager.cc:194] Registered new tserver with Master: ba7d5ef6ffcc49c4921b59375cbd645d (127.12.145.1:34353)
I20260811 06:50:28.964200 26850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:50493
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:50:29.001879 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:40415
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:38973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:29.329928 27207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:29.330212 27207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:29.330335 27207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:29.337754 27207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:29.337868 27207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:29.338043 27207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:50:29.347987 27207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:38973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:40415
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:29.349337 27207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:29.350713 27207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:29.364377 27224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:29.364349 27225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:29.364377 27228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:29.365389 27207 server_base.cc:1034] running on GCE node
I20260811 06:50:29.366088 27207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:29.367100 27207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:29.368301 27207 hybrid_clock.cc:648] HybridClock initialized: now 1786431029368239 us; error 70 us; skew 500 ppm
I20260811 06:50:29.368623 27207 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:29 dist-test-slave-7lbf krb5kdc[26774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431029, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:29.371824 27207 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:50:29.373409 27207 webserver.cc:460] Webserver started at http://127.12.145.2:35601/ using document root <none> and password file <none>
I20260811 06:50:29.374161 27207 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:29.374269 27207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:29.374590 27207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:29.377606 27207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "7bcaa93b5eed40a28492468cf98e8e2e"
format_stamp: "Formatted at 2026-08-11 06:50:29 on dist-test-slave-7lbf"
server_key: "33e92cfe3acdb5badfa900249a019d63"
server_key_iv: "8198500eb621745bd07fb72822372fe6"
server_key_version: "encryptionkey@0"
I20260811 06:50:29.378476 27207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "7bcaa93b5eed40a28492468cf98e8e2e"
format_stamp: "Formatted at 2026-08-11 06:50:29 on dist-test-slave-7lbf"
server_key: "33e92cfe3acdb5badfa900249a019d63"
server_key_iv: "8198500eb621745bd07fb72822372fe6"
server_key_version: "encryptionkey@0"
I20260811 06:50:29.384253 27207 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 06:50:29.388018 27245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:29.389457 27207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:50:29.389688 27207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "7bcaa93b5eed40a28492468cf98e8e2e"
format_stamp: "Formatted at 2026-08-11 06:50:29 on dist-test-slave-7lbf"
server_key: "33e92cfe3acdb5badfa900249a019d63"
server_key_iv: "8198500eb621745bd07fb72822372fe6"
server_key_version: "encryptionkey@0"
I20260811 06:50:29.389881 27207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:29.420472 27207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:29.424603 27207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:29.424889 27207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:29.425909 27207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:29.427269 27207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:29.427343 27207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:29.427456 27207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:29.427517 27207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:29.457894 27207 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:43995
I20260811 06:50:29.457996 27440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:43995 every 8 connection(s)
I20260811 06:50:29.459223 27207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:50:29.467314 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 27207
I20260811 06:50:29.467523 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:50:29.467980 12868 external_mini_cluster.cc:1428] Setting key 19c306d410e79f90f5832a0eb02bb749
Aug 11 06:50:29 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431029, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:50:29.479537 27443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:29.461642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:50799 (local address 127.12.145.62:40415)
0811 06:50:29.462075 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:29.462080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:29.462958 (+ 878us) server_negotiation.cc:407] Connection header received
0811 06:50:29.464832 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:29.464838 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:29.464921 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:29.465017 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:29.466565 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:29.467364 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:29.469053 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:29.469568 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:29.469679 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:29.473716 (+ 4037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:29.473721 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:29.473725 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:29.473759 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:29.476285 (+ 2526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:29.477105 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:29.477109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:29.477111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:29.477242 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:29.477722 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:29.477726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:29.477728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:29.478017 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:29.478136 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:29.479023 (+ 887us) server_negotiation.cc:299] Negotiation successful
0811 06:50:29.479197 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":220,"threads_started":1}
I20260811 06:50:29.480873 27446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:29.462139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:50799)
0811 06:50:29.462811 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:29.462849 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:29.464568 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:29.465261 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:29.465269 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:29.465816 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:29.466395 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:29.466412 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:29.467519 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:29.467524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:29.468914 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:29.468926 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:29.469780 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:29.469787 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:29.470085 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:29.470780 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:29.470814 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:29.473453 (+ 2639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:29.476428 (+ 2975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:29.476437 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:29.476453 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:29.477003 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:29.477339 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:29.477344 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:29.477347 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:29.477626 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:29.478140 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:29.478147 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:29.478626 (+ 479us) client_negotiation.cc:769] Sending connection context
0811 06:50:29.478927 (+ 301us) client_negotiation.cc:240] Negotiation successful
0811 06:50:29.479440 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":267,"threads_started":1}
I20260811 06:50:29.482375 27441 heartbeater.cc:347] Connected to a master server at 127.12.145.62:40415
I20260811 06:50:29.482676 27441 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:29.483386 27441 heartbeater.cc:511] Master 127.12.145.62:40415 requested a full tablet report, sending...
I20260811 06:50:29.484864 26850 ts_manager.cc:194] Registered new tserver with Master: 7bcaa93b5eed40a28492468cf98e8e2e (127.12.145.2:43995)
I20260811 06:50:29.485996 26850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:50799
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:50:29.528213 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:40415
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:38973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:29.854985 27453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:29.855288 27453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:29.855415 27453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:29.862624 27453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:29.862741 27453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:29.862898 27453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:50:29.872717 27453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:38973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:40415
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:29.874020 27453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:29.875325 27453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:29.887789 27463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:29.887848 27460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:29.887812 27459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:29.888595 27453 server_base.cc:1034] running on GCE node
I20260811 06:50:29.889153 27453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:29.890087 27453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:29.891295 27453 hybrid_clock.cc:648] HybridClock initialized: now 1786431029891249 us; error 45 us; skew 500 ppm
I20260811 06:50:29.891598 27453 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:29 dist-test-slave-7lbf krb5kdc[26774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431029, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:29.894666 27453 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:50:29.896068 27453 webserver.cc:460] Webserver started at http://127.12.145.3:42775/ using document root <none> and password file <none>
I20260811 06:50:29.896685 27453 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:29.896783 27453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:29.897045 27453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:29.899858 27453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "e71af6d934b44448b754f51df6300393"
format_stamp: "Formatted at 2026-08-11 06:50:29 on dist-test-slave-7lbf"
server_key: "86a5e30bde97ceeaa89adba8a4567ff8"
server_key_iv: "2e2986b6c1904dee31f0d122e794568a"
server_key_version: "encryptionkey@0"
I20260811 06:50:29.900604 27453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "e71af6d934b44448b754f51df6300393"
format_stamp: "Formatted at 2026-08-11 06:50:29 on dist-test-slave-7lbf"
server_key: "86a5e30bde97ceeaa89adba8a4567ff8"
server_key_iv: "2e2986b6c1904dee31f0d122e794568a"
server_key_version: "encryptionkey@0"
I20260811 06:50:29.905478 27453 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260811 06:50:29.908733 27478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:29.910040 27453 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:50:29.910172 27453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "e71af6d934b44448b754f51df6300393"
format_stamp: "Formatted at 2026-08-11 06:50:29 on dist-test-slave-7lbf"
server_key: "86a5e30bde97ceeaa89adba8a4567ff8"
server_key_iv: "2e2986b6c1904dee31f0d122e794568a"
server_key_version: "encryptionkey@0"
I20260811 06:50:29.910336 27453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:29.922938 27453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:29.926560 27453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:29.926796 27453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:29.927654 27453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:29.928910 27453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:29.928982 27453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:29.929070 27453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:29.929116 27453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:29.960054 27453 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:42459
I20260811 06:50:29.960103 27659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:42459 every 8 connection(s)
I20260811 06:50:29.961275 27453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:50:29.964192 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 27453
I20260811 06:50:29.964365 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:50:29.964836 12868 external_mini_cluster.cc:1428] Setting key ac8fc921f4bde4c082b0f1828e7c55d2
I20260811 06:50:29.967985 27194 heartbeater.cc:503] Master 127.12.145.62:40415 was elected leader, sending a full tablet report...
Aug 11 06:50:29 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431029, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:50:29.981189 27443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:29.963789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:53113 (local address 127.12.145.62:40415)
0811 06:50:29.964023 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:29.964029 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:29.965353 (+ 1324us) server_negotiation.cc:407] Connection header received
0811 06:50:29.967403 (+ 2050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:29.967408 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:29.967495 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:29.967619 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:29.969537 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:29.970288 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:29.971789 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:29.972172 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:29.972259 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:29.975680 (+ 3421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:29.975685 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:29.975689 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:29.975722 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:29.978105 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:29.978971 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:29.978977 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:29.978980 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:29.979133 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:29.979627 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:29.979633 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:29.979640 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:29.979965 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:29.980116 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:29.980785 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 06:50:29.980956 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 06:50:29.982430 27673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:29.964337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:53113)
0811 06:50:29.965155 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:29.965209 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:29.967155 (+ 1946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:29.967860 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:29.967872 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:29.968562 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:29.969343 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:29.969370 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:29.970433 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:29.970437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:29.971681 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:29.971694 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:29.972357 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:29.972362 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:29.972547 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:29.973199 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:29.973221 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:29.975488 (+ 2267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:29.978251 (+ 2763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:29.978260 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:29.978275 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:29.978867 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:29.979251 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:29.979255 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:29.979258 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:29.979510 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:29.980092 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:29.980100 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:29.980472 (+ 372us) client_negotiation.cc:769] Sending connection context
0811 06:50:29.980693 (+ 221us) client_negotiation.cc:240] Negotiation successful
0811 06:50:29.981072 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":290,"threads_started":1}
I20260811 06:50:29.983716 27660 heartbeater.cc:347] Connected to a master server at 127.12.145.62:40415
I20260811 06:50:29.984001 27660 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:29.984793 27660 heartbeater.cc:511] Master 127.12.145.62:40415 requested a full tablet report, sending...
I20260811 06:50:29.986192 26850 ts_manager.cc:194] Registered new tserver with Master: e71af6d934b44448b754f51df6300393 (127.12.145.3:42459)
I20260811 06:50:29.986994 26850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:53113
I20260811 06:50:29.992167 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab.
Entry for principal oryx/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab.
WARNING: no policy specified for oryx/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab.
Entry for principal oryx/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab.
WARNING: no policy specified for oryx/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab.
Entry for principal oryx/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab.
I20260811 06:50:30.146453 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 26957
Aug 11 06:50:30 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:50:30.161932 27685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:30.147585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54214 (local address 127.12.145.1:34353)
0811 06:50:30.148260 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:30.148267 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:30.148295 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:50:30.148360 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:30.148367 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:30.148599 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:30.148740 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:30.150124 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:30.151186 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:30.152411 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:30.152980 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:30.153077 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:30.156846 (+ 3769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:30.156859 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:30.156875 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:30.156910 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:30.159665 (+ 2755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:30.160256 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:30.160263 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:30.160265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:30.160387 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:30.160651 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:30.160654 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:30.160656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:30.160986 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:30.161214 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:30.161402 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 06:50:30.161645 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":372,"threads_started":1}
I20260811 06:50:30.163251 27186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:30.245501 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 26957
I20260811 06:50:30.270707 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 27207
Aug 11 06:50:30 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:50:30.285748 27691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:30.271566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47264 (local address 127.12.145.2:43995)
0811 06:50:30.272074 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:30.272082 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:30.272109 (+ 27us) server_negotiation.cc:407] Connection header received
0811 06:50:30.272171 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:30.272177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:30.272380 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:30.272520 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:30.273681 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:30.274664 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:30.275837 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:30.276354 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:30.276458 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:30.280483 (+ 4025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:30.280495 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:30.280510 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:30.280543 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:30.283293 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:30.283884 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:30.283890 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:30.283892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:30.284008 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:30.284264 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:30.284274 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:30.284276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:30.284607 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:30.284845 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:30.285011 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 06:50:30.285225 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":247,"threads_started":1}
I20260811 06:50:30.287118 27435 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:30.367739 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 27207
I20260811 06:50:30.390213 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 27453
Aug 11 06:50:30 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:50:30.406783 27693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:30.391228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56398 (local address 127.12.145.3:42459)
0811 06:50:30.391884 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:30.391891 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:30.391920 (+ 29us) server_negotiation.cc:407] Connection header received
0811 06:50:30.391986 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:30.391993 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:30.392207 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:30.392365 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:30.393750 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:30.394795 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:30.396103 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:30.396678 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:30.396799 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:30.401107 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:30.401120 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:30.401136 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:30.401171 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:30.403960 (+ 2789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:30.404618 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:30.404626 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:30.404628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:30.404762 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:30.405126 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:30.405130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:30.405132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:30.405487 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:30.405836 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:30.406178 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 06:50:30.406437 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":345,"threads_started":1}
I20260811 06:50:30.408018 27653 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:30.490525 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 27453
I20260811 06:50:30.513777 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 26795
I20260811 06:50:30.515101 26899 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:30.618180 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 26795
I20260811 06:50:30.645645 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:40415
--webserver_interface=127.12.145.62
--webserver_port=46021
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:38973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:40415
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:30.979312 27698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:30.979617 27698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:30.979755 27698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:30.987028 27698 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:50:30.987150 27698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:30.987231 27698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:30.987308 27698 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:50:30.987371 27698 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:50:30.997215 27698 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:38973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:40415
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:40415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=46021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:30.998540 27698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:30.999898 27698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:31.011415 27703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:31.011539 27707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:31.011828 27705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:31.012894 27698 server_base.cc:1034] running on GCE node
I20260811 06:50:31.013805 27698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:31.015256 27698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:31.016465 27698 hybrid_clock.cc:648] HybridClock initialized: now 1786431031016415 us; error 37 us; skew 500 ppm
I20260811 06:50:31.016834 27698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:31 dist-test-slave-7lbf krb5kdc[26774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431031, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:31.019938 27698 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:50:31.021442 27698 webserver.cc:460] Webserver started at http://127.12.145.62:46021/ using document root <none> and password file <none>
I20260811 06:50:31.022153 27698 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:31.022289 27698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:31.027851 27698 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 06:50:31.030717 27718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:31.032025 27698 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:50:31.032186 27698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a"
format_stamp: "Formatted at 2026-08-11 06:50:28 on dist-test-slave-7lbf"
server_key: "fb9e4e560071f4055324e55d1121cebd"
server_key_iv: "5807a19ce5f9433b9dd8649b298e6329"
server_key_version: "encryptionkey@0"
I20260811 06:50:31.033167 27698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:31.056519 27698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:31.060747 27698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:31.061009 27698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:31.079793 27698 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:40415
I20260811 06:50:31.079800 27800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:40415 every 8 connection(s)
I20260811 06:50:31.081290 27698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:50:31.088191 27801 sys_catalog.cc:263] Verifying existing consensus state
I20260811 06:50:31.089427 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 27698
I20260811 06:50:31.090230 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:34353
--local_ip_for_outbound_sockets=127.12.145.1
--tserver_master_addrs=127.12.145.62:40415
--webserver_port=39717
--webserver_interface=127.12.145.1
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:38973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.145.1
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:50:31.091552 27801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a: Bootstrap starting.
I20260811 06:50:31.110814 27801 log.cc:824] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:31.120266 27801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 06:50:31.120783 27801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a: Bootstrap complete.
I20260811 06:50:31.130023 27801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } }
I20260811 06:50:31.130920 27801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299b0eb92e3b4aa5ac3148f6a24fd40a, State: Initialized, Role: FOLLOWER
I20260811 06:50:31.131582 27801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } }
I20260811 06:50:31.131816 27801 raft_consensus.cc:388] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:50:31.131932 27801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:50:31.132102 27801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:50:31.136062 27801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } }
I20260811 06:50:31.136612 27801 leader_election.cc:302] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 299b0eb92e3b4aa5ac3148f6a24fd40a; no voters:
I20260811 06:50:31.137243 27801 leader_election.cc:288] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 06:50:31.137394 27808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 2 FOLLOWER]: Leader election won for term 2
I20260811 06:50:31.138828 27808 raft_consensus.cc:686] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [term 2 LEADER]: Becoming Leader. State: Replica: 299b0eb92e3b4aa5ac3148f6a24fd40a, State: Running, Role: LEADER
I20260811 06:50:31.139479 27808 consensus_queue.cc:237] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } }
I20260811 06:50:31.139787 27801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:50:31.142150 27810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 299b0eb92e3b4aa5ac3148f6a24fd40a. Latest consensus state: current_term: 2 leader_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } } }
I20260811 06:50:31.142562 27810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:31.142457 27809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299b0eb92e3b4aa5ac3148f6a24fd40a" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 40415 } } }
I20260811 06:50:31.142808 27809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:31.152465 27819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:50:31.158520 27819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:50:31.160077 27819 catalog_manager.cc:1259] Loaded cluster ID: 67d073ce25cb41acafc1b767af6d48cb
I20260811 06:50:31.160230 27819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:50:31.164415 27819 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:50:31.166038 27819 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 299b0eb92e3b4aa5ac3148f6a24fd40a: Loaded TSK: 0
I20260811 06:50:31.167762 27819 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 06:50:31.454840 27805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:31.455201 27805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:31.455349 27805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:31.462692 27805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:31.462807 27805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:31.462970 27805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:50:31.472532 27805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:38973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.1.keytab
--principal=oryx/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:34353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=39717
--tserver_master_addrs=127.12.145.62:40415
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:31.473912 27805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:31.475229 27805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:31.489948 27841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:31.490442 27844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:31.490823 27840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:31.491118 27805 server_base.cc:1034] running on GCE node
I20260811 06:50:31.491731 27805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:31.492664 27805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:31.493860 27805 hybrid_clock.cc:648] HybridClock initialized: now 1786431031493806 us; error 44 us; skew 500 ppm
I20260811 06:50:31.494218 27805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:31 dist-test-slave-7lbf krb5kdc[26774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431031, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:31.497426 27805 init.cc:377] Logged in from keytab as oryx/127.12.145.1@KRBTEST.COM (short username oryx)
I20260811 06:50:31.498929 27805 webserver.cc:460] Webserver started at http://127.12.145.1:39717/ using document root <none> and password file <none>
I20260811 06:50:31.499639 27805 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:31.499774 27805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:31.505774 27805 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 06:50:31.508786 27858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:31.510211 27805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:50:31.510370 27805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "ba7d5ef6ffcc49c4921b59375cbd645d"
format_stamp: "Formatted at 2026-08-11 06:50:28 on dist-test-slave-7lbf"
server_key: "417e0c6f72d243c4840730285b1890c4"
server_key_iv: "aa9beedc1fcdac774eb4cab53ea6720b"
server_key_version: "encryptionkey@0"
I20260811 06:50:31.511303 27805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:31.535082 27805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:31.539283 27805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:31.539516 27805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:31.540508 27805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:31.541954 27805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:31.542047 27805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:31.542132 27805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:31.542181 27805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:31.572201 27805 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:34353
I20260811 06:50:31.572275 28030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:34353 every 8 connection(s)
I20260811 06:50:31.573647 27805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:50:31.577385 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 27805
I20260811 06:50:31.578009 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:43995
--local_ip_for_outbound_sockets=127.12.145.2
--tserver_master_addrs=127.12.145.62:40415
--webserver_port=35601
--webserver_interface=127.12.145.2
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:38973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.145.2
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:50:31 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:31 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 06:50:31.899871 28041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:31.900147 28041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:31.900266 28041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:31.907361 28041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:31.907474 28041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:31.907631 28041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:50:31.917371 28041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:38973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.2.keytab
--principal=oryx/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:43995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=35601
--tserver_master_addrs=127.12.145.62:40415
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:31.918661 28041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:31.919951 28041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:31.935410 28052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:31.935458 28055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:31.936576 28041 server_base.cc:1034] running on GCE node
W20260811 06:50:31.936807 28051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:31.937634 28041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:31.938587 28041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:31.939811 28041 hybrid_clock.cc:648] HybridClock initialized: now 1786431031939736 us; error 66 us; skew 500 ppm
I20260811 06:50:31.940137 28041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:31 dist-test-slave-7lbf krb5kdc[26774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431031, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:31.943425 28041 init.cc:377] Logged in from keytab as oryx/127.12.145.2@KRBTEST.COM (short username oryx)
I20260811 06:50:31.945043 28041 webserver.cc:460] Webserver started at http://127.12.145.2:35601/ using document root <none> and password file <none>
I20260811 06:50:31.945766 28041 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:31.945890 28041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:31.951637 28041 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 06:50:31.954612 28069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:31.956087 28041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:50:31.956246 28041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "7bcaa93b5eed40a28492468cf98e8e2e"
format_stamp: "Formatted at 2026-08-11 06:50:29 on dist-test-slave-7lbf"
server_key: "33e92cfe3acdb5badfa900249a019d63"
server_key_iv: "8198500eb621745bd07fb72822372fe6"
server_key_version: "encryptionkey@0"
I20260811 06:50:31.957204 28041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:31.974977 28041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:31.978941 28041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:31.979190 28041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:31.980217 28041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:31.981606 28041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:31.981705 28041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:31.981807 28041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:31.981881 28041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:32.016708 28041 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:43995
I20260811 06:50:32.016762 28259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:43995 every 8 connection(s)
I20260811 06:50:32.018332 28041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:50:32.023275 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 28041
I20260811 06:50:32.023837 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:42459
--local_ip_for_outbound_sockets=127.12.145.3
--tserver_master_addrs=127.12.145.62:40415
--webserver_port=42775
--webserver_interface=127.12.145.3
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:38973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.145.3
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:50:32 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:32 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 06:50:32.567214 28265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:32.567691 28265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:32.567942 28265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:32.579855 28265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:32.579991 28265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:32.580148 28265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:50:32.594934 28265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:38973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/krb5kdc/oryx_127.12.145.3.keytab
--principal=oryx/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:42459
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=42775
--tserver_master_addrs=127.12.145.62:40415
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:32.596390 28265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:32.598199 28265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:32.615567 28277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:32.615598 28280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:32.619784 28282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:32.620476 28265 server_base.cc:1034] running on GCE node
I20260811 06:50:32.621356 28265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:32.622754 28265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:32.624009 28265 hybrid_clock.cc:648] HybridClock initialized: now 1786431032623949 us; error 42 us; skew 500 ppm
I20260811 06:50:32.624447 28265 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:32 dist-test-slave-7lbf krb5kdc[26774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431032, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:32.628742 28265 init.cc:377] Logged in from keytab as oryx/127.12.145.3@KRBTEST.COM (short username oryx)
I20260811 06:50:32.630524 28265 webserver.cc:460] Webserver started at http://127.12.145.3:42775/ using document root <none> and password file <none>
I20260811 06:50:32.631332 28265 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:32.631464 28265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:32.637930 28265 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 06:50:32.641099 28292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:32.642899 28265 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 06:50:32.643107 28265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "e71af6d934b44448b754f51df6300393"
format_stamp: "Formatted at 2026-08-11 06:50:29 on dist-test-slave-7lbf"
server_key: "86a5e30bde97ceeaa89adba8a4567ff8"
server_key_iv: "2e2986b6c1904dee31f0d122e794568a"
server_key_version: "encryptionkey@0"
I20260811 06:50:32.644146 28265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:32.663295 28265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:32.668013 28265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:32.668308 28265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:32.669538 28265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:32.671185 28265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:32.671296 28265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:32.671417 28265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:32.671501 28265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:32.721230 28265 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:42459
I20260811 06:50:32.721424 28465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:42459 every 8 connection(s)
I20260811 06:50:32.723224 28265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:50:32.728665 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 28265
Aug 11 06:50:32 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:32 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:32.773272 28472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:32.729951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53416 (local address 127.12.145.62:40415)
0811 06:50:32.748338 (+ 18387us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:32.748342 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:32.748359 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:50:32.748456 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:32.748462 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:32.748542 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:32.748665 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:32.752550 (+ 3885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.753770 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.757157 (+ 3387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.757848 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.758030 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:32.761928 (+ 3898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:32.761946 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:32.761969 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:32.762034 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:32.766609 (+ 4575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:32.767603 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:32.767613 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:32.767622 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:32.767848 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:32.768799 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:32.768805 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:32.768808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:32.769978 (+ 1170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:32.771154 (+ 1176us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:32.771506 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 06:50:32.772057 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18293,"thread_start_us":17761,"threads_started":1}
W20260811 06:50:32.825413 28039 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.238s user 0.005s sys 0.007s
W20260811 06:50:32.827508 28034 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:31.576603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:43647 (local address 127.12.145.62:40415)
0811 06:50:31.577403 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:31.577418 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:31.578036 (+ 618us) server_negotiation.cc:407] Connection header received
0811 06:50:31.580215 (+ 2179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:31.580235 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:31.580648 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:31.581040 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:31.582423 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:31.584083 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:31.585575 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:31.586490 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:31.586654 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:32.827071 (+1240417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:43647: BlockingRecv error: recv got EOF from 127.12.145.1:43647 (error 108)
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":262,"threads_started":1}
I20260811 06:50:32.827968 28039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:31.576638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:43647)
0811 06:50:31.577843 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:31.577887 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:31.579600 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:31.581131 (+ 1531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:31.581138 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:31.581703 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:31.582230 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:31.582248 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:31.584211 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:31.584214 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:31.585413 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:31.585426 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:31.586677 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:31.586682 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:31.586863 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:31.587480 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:31.587502 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:32.826591 (+1239089us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":944,"thread_start_us":663,"threads_started":1}
W20260811 06:50:32.829070 28032 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:40415 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.145.62:40415: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Aug 11 06:50:32 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:32 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:32.843426 28039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:32.829892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:55659)
0811 06:50:32.830627 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:32.830651 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:32.830850 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:32.831418 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:32.831423 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:32.831962 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:32.832195 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:32.832207 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.833900 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.833906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:32.835580 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:32.835596 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.836801 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.836816 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:32.837018 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:32.837882 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:32.837908 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:32.843021 (+ 5113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":578}
W20260811 06:50:32.844797 28034 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:32.830253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:55659 (local address 127.12.145.62:40415)
0811 06:50:32.830438 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:32.830447 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:32.830722 (+ 275us) server_negotiation.cc:407] Connection header received
0811 06:50:32.830999 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:32.831005 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:32.831092 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:32.831163 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:32.832383 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.833740 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.835733 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.836576 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.836748 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:32.844495 (+ 7747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:55659: BlockingRecv error: recv got EOF from 127.12.145.1:55659 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 06:50:32 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:32 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:32.858264 28477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:32.844390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:41253)
0811 06:50:32.845894 (+ 1504us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:32.845918 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:32.846077 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:32.846464 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:32.846469 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:32.847233 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:32.847565 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:32.847577 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.849138 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.849144 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:32.850895 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:32.850914 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.852043 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.852053 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:32.852255 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:32.853011 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:32.853035 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:32.857899 (+ 4864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1342,"thread_start_us":1074,"threads_started":1}
W20260811 06:50:32.858616 28032 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 06:50:32.858740 28472 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:32.845040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:41253 (local address 127.12.145.62:40415)
0811 06:50:32.845235 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:32.845242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:32.846025 (+ 783us) server_negotiation.cc:407] Connection header received
0811 06:50:32.846211 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:32.846217 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:32.846313 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:32.846424 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:32.847719 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.848958 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.851058 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.851795 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.851940 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:32.858183 (+ 6243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:41253: BlockingRecv error: recv got EOF from 127.12.145.1:41253 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 06:50:33.055203 28264 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.021s user 0.000s sys 0.012s
W20260811 06:50:33.056730 28263 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:32.020967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:36613 (local address 127.12.145.62:40415)
0811 06:50:32.021506 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:32.021533 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:32.022522 (+ 989us) server_negotiation.cc:407] Connection header received
0811 06:50:32.025496 (+ 2974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:32.025501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:32.025614 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:32.025722 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:32.028013 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.029000 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.031655 (+ 2655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.032197 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.032332 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.056335 (+1024003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:36613: BlockingRecv error: recv got EOF from 127.12.145.2:36613 (error 108)
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":259,"threads_started":1}
I20260811 06:50:33.056854 28264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:32.021363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:36613)
0811 06:50:32.022321 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:32.022389 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:32.025139 (+ 2750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:32.026051 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:32.026064 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:32.026893 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:32.027785 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:32.027813 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.029176 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.029183 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:32.031462 (+ 2279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:32.031481 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.032443 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.032451 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:32.032792 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:32.033636 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:32.033660 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:33.055960 (+1022300us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":330,"threads_started":1}
W20260811 06:50:33.058028 28261 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:40415 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.145.62:40415: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Aug 11 06:50:33 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:33 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:33.067961 28264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:33.058865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:51993)
0811 06:50:33.059068 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:33.059091 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:33.059212 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:33.059529 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:33.059534 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:33.059944 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:33.060163 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:33.060174 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.061224 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.061230 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:33.062249 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:33.062262 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.062985 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.062992 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:33.063138 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.063786 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:33.063803 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:33.067752 (+ 3949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 06:50:33.068320 28263 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:33.059000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:51993 (local address 127.12.145.62:40415)
0811 06:50:33.059182 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:33.059187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:33.059206 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:50:33.059330 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:33.059335 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:33.059399 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:33.059492 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:33.060302 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.061079 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.062388 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.062803 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.062915 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.068033 (+ 5118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:51993: BlockingRecv error: recv got EOF from 127.12.145.2:51993 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 06:50:33 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:33 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:33.078645 28264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:33.069096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:43085)
0811 06:50:33.069276 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:33.069296 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:33.069395 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:33.069983 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:33.069987 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:33.070253 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:33.070401 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:33.070409 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.071949 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.071952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:33.072892 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:33.072903 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.073939 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.073943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:33.074089 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.074693 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:33.074713 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:33.078368 (+ 3655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 06:50:33.078837 28263 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:33.069327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:43085 (local address 127.12.145.62:40415)
0811 06:50:33.069546 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:33.069553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:33.069575 (+ 22us) server_negotiation.cc:407] Connection header received
0811 06:50:33.069734 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:33.069740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:33.069840 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:33.069946 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:33.070559 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.071818 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.073012 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.073792 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.073927 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.078589 (+ 4662us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:43085: BlockingRecv error: recv got EOF from 127.12.145.2:43085 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 06:50:33.079010 28261 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 06:50:33.771848 28471 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.005s user 0.002s sys 0.016s
W20260811 06:50:33.773123 28473 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:32.727934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:38049 (local address 127.12.145.62:40415)
0811 06:50:32.748019 (+ 20085us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:32.748024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:32.754762 (+ 6738us) server_negotiation.cc:407] Connection header received
0811 06:50:32.757064 (+ 2302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:32.757070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:32.757157 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:32.757266 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:32.760613 (+ 3347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.761862 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.764398 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.765095 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.765202 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.772846 (+1007644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:38049: BlockingRecv error: recv got EOF from 127.12.145.3:38049 (error 108)
Metrics: {"server-negotiator.queue_time_us":19957,"thread_start_us":20203,"threads_started":1}
I20260811 06:50:33.773765 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:32.727251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:38049)
0811 06:50:32.754566 (+ 27315us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:32.754640 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:32.756787 (+ 2147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:32.757887 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:32.757901 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:32.759431 (+ 1530us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:32.760361 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:32.760391 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.762075 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.762080 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:32.764204 (+ 2124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:32.764222 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:32.765653 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:32.765683 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:32.766022 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:32.766731 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:32.766766 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:33.772632 (+1005866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26937,"thread_start_us":26699,"threads_started":1}
W20260811 06:50:33.774704 28466 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:40415 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.145.62:40415: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Aug 11 06:50:33 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:33 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:33.787657 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:33.775355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:51217)
0811 06:50:33.775636 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:33.775654 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:33.775784 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:33.776152 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:33.776156 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:33.776603 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:33.776793 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:33.776806 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.777891 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.777895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:33.778867 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:33.778879 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.779581 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.779585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:33.779701 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.783748 (+ 4047us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:33.783768 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:33.787386 (+ 3618us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156}
W20260811 06:50:33.787858 28473 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:33.775426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:51217 (local address 127.12.145.62:40415)
0811 06:50:33.775607 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:33.775614 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:33.775762 (+ 148us) server_negotiation.cc:407] Connection header received
0811 06:50:33.775897 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:33.775903 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:33.775989 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:33.776085 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:33.776948 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.777760 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.779030 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.779444 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.779553 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.787601 (+ 8048us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:51217: BlockingRecv error: recv got EOF from 127.12.145.3:51217 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 06:50:33 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:33 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:33.795933 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:33.788320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:43477)
0811 06:50:33.788478 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:33.788499 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:33.788606 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:33.788935 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:33.788939 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:33.789256 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:33.789409 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:33.789417 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.790391 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.790395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:33.791353 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:33.791365 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.792053 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.792059 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:33.792219 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.792699 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:33.792715 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:33.795667 (+ 2952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 06:50:33.796234 28473 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:33.788393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:43477 (local address 127.12.145.62:40415)
0811 06:50:33.788621 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:33.788626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:33.788644 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:50:33.788709 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:33.788714 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:33.788800 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:33.788879 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:33.789566 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.790251 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.791498 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.791904 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.792013 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.795874 (+ 3861us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:43477: BlockingRecv error: recv got EOF from 127.12.145.3:43477 (error 108)
Metrics: {"server-negotiator.queue_time_us":120}
W20260811 06:50:33.796254 28466 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 06:50:33 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:33 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:33.868594 28481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:33.859348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:59999)
0811 06:50:33.859966 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:33.859988 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:33.860145 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:33.860512 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:33.860517 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:33.861077 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:33.861287 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:33.861298 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.862425 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.862431 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:33.863379 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:33.863392 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.864110 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.864117 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:33.864292 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.864891 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:33.864908 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:33.868353 (+ 3445us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":419,"threads_started":1}
W20260811 06:50:33.868786 28473 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:33.859490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:59999 (local address 127.12.145.62:40415)
0811 06:50:33.859699 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:33.859706 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:33.860082 (+ 376us) server_negotiation.cc:407] Connection header received
0811 06:50:33.860289 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:33.860294 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:33.860370 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:33.860453 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:33.861440 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.862270 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.863535 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:33.863958 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:33.864070 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:33.868581 (+ 4511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:59999: BlockingRecv error: recv got EOF from 127.12.145.1:59999 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 06:50:34 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:34 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:34.088523 28482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:34.079618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:58667)
0811 06:50:34.080156 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:34.080173 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:34.080313 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:34.080646 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:34.080651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:34.081115 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:34.081270 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:34.081278 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.082402 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.082406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:34.083376 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:34.083388 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.084183 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.084190 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:34.084362 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:34.084943 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:34.084961 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:34.088274 (+ 3313us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":298,"threads_started":1}
W20260811 06:50:34.088686 28473 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:34.079686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:58667 (local address 127.12.145.62:40415)
0811 06:50:34.079924 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:34.079931 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:34.080267 (+ 336us) server_negotiation.cc:407] Connection header received
0811 06:50:34.080438 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:34.080444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:34.080508 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:34.080588 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:34.081417 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.082252 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.083519 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.084003 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.084112 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:34.088482 (+ 4370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:58667: BlockingRecv error: recv got EOF from 127.12.145.2:58667 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 06:50:34 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:34 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:34.805895 28484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:34.796870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:51593)
0811 06:50:34.797407 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:34.797429 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:34.797588 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:34.797958 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:34.797961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:34.798390 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:34.798542 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:34.798552 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.799526 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.799531 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:34.800515 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:34.800528 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.801270 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.801274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:34.801397 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:34.801996 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:34.802015 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:34.805649 (+ 3634us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":311,"threads_started":1}
W20260811 06:50:34.806064 28485 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:34.797043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:51593 (local address 127.12.145.62:40415)
0811 06:50:34.797701 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:34.797705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:34.797720 (+ 15us) server_negotiation.cc:407] Connection header received
0811 06:50:34.797765 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:34.797769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:34.797835 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:34.797922 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:34.798656 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.799396 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.800654 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.801106 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.801200 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:34.805836 (+ 4636us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:51593: BlockingRecv error: recv got EOF from 127.12.145.3:51593 (error 108)
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":459,"threads_started":1}
Aug 11 06:50:34 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:34 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:34.878382 28487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:34.869639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:35495)
0811 06:50:34.870127 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:34.870145 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:34.870266 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:34.870589 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:34.870596 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:34.871027 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:34.871199 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:34.871208 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.872209 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.872213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:34.873175 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:34.873187 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.873897 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.873901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:34.874031 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:34.874617 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:34.874635 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:34.878070 (+ 3435us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":269,"threads_started":1}
W20260811 06:50:34.878448 28485 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:34.869695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:35495 (local address 127.12.145.62:40415)
0811 06:50:34.869872 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:34.869877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:34.870214 (+ 337us) server_negotiation.cc:407] Connection header received
0811 06:50:34.870373 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:34.870377 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:34.870440 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:34.870514 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:34.871336 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.872084 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.873306 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:34.873747 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:34.873838 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:34.878262 (+ 4424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:35495: BlockingRecv error: recv got EOF from 127.12.145.1:35495 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 06:50:35 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:35 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:35.098688 28488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:35.089569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:52627)
0811 06:50:35.090113 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:35.090134 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:35.090300 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:35.090685 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:35.090689 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:35.091244 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:35.091478 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:35.091490 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.092492 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.092498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:35.093415 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:35.093427 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.094152 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.094158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:35.094327 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:35.094921 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:35.094939 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:35.098414 (+ 3475us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":313,"threads_started":1}
W20260811 06:50:35.098804 28485 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:35.089673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:52627 (local address 127.12.145.62:40415)
0811 06:50:35.089887 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:35.089894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:35.090226 (+ 332us) server_negotiation.cc:407] Connection header received
0811 06:50:35.090444 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:35.090448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:35.090511 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:35.090613 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:35.091621 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.092347 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.093581 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.094003 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.094114 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:35.098602 (+ 4488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:52627: BlockingRecv error: recv got EOF from 127.12.145.2:52627 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 06:50:35 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:35 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:35.815538 28491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:35.806780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:52717)
0811 06:50:35.807309 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:35.807336 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:35.807456 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:35.807756 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:35.807759 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:35.808162 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:35.808351 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:35.808360 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.809371 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.809375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:35.810335 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:35.810347 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.811117 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.811120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:35.811245 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:35.811774 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:35.811790 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:35.815266 (+ 3476us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":262,"threads_started":1}
W20260811 06:50:35.815896 28492 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:35.806909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:52717 (local address 127.12.145.62:40415)
0811 06:50:35.807450 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:35.807454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:35.807473 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:50:35.807555 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:35.807559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:35.807635 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:35.807734 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:35.808467 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.809268 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.810486 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.810982 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.811093 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:35.815494 (+ 4401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:52717: BlockingRecv error: recv got EOF from 127.12.145.3:52717 (error 108)
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":293,"threads_started":1}
Aug 11 06:50:35 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:35 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:35.888016 28493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:35.879291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:57697)
0811 06:50:35.879786 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:35.879805 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:35.879946 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:35.880266 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:35.880270 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:35.880687 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:35.880868 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:35.880878 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.881992 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.881996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:35.882951 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:35.882965 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.883672 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.883678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:35.883845 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:35.884432 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:35.884451 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:35.887782 (+ 3331us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":266,"threads_started":1}
W20260811 06:50:35.888227 28492 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:35.879384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:57697 (local address 127.12.145.62:40415)
0811 06:50:35.879575 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:35.879581 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:35.879897 (+ 316us) server_negotiation.cc:407] Connection header received
0811 06:50:35.880063 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:35.880068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:35.880139 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:35.880220 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:35.881018 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.881851 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.883091 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:35.883530 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:35.883638 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:35.887996 (+ 4358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:57697: BlockingRecv error: recv got EOF from 127.12.145.1:57697 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 06:50:36 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:36 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:36.108843 28495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:36.099698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:35045)
0811 06:50:36.100228 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:36.100244 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:36.100381 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:36.100741 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:36.100746 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:36.101146 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:36.101332 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:36.101342 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.102647 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.102652 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:36.103572 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:36.103583 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.104264 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.104270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:36.104446 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:36.105030 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:36.105048 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:36.108431 (+ 3383us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":291,"threads_started":1}
W20260811 06:50:36.108990 28492 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:36.099786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:35045 (local address 127.12.145.62:40415)
0811 06:50:36.099985 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:36.099991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:36.100338 (+ 347us) server_negotiation.cc:407] Connection header received
0811 06:50:36.100521 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:36.100525 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:36.100601 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:36.100683 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:36.101484 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.102517 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.103707 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.104129 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.104237 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:36.108708 (+ 4471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:35045: BlockingRecv error: recv got EOF from 127.12.145.2:35045 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 06:50:36 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:36 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:36.830230 28496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:36.816632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:41277)
0811 06:50:36.817146 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:36.817170 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:36.817302 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:36.817929 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:36.817935 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:36.818414 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:36.818652 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:36.818666 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.821886 (+ 3220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.821891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:36.823031 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:36.823045 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.824514 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.824520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:36.824702 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:36.825351 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:36.825377 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:36.829910 (+ 4533us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":258,"threads_started":1}
W20260811 06:50:36.830518 28499 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:36.817046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:41277 (local address 127.12.145.62:40415)
0811 06:50:36.817594 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:36.817600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:36.817620 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:50:36.817682 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:36.817687 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:36.817768 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:36.817886 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:36.818821 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.819760 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.823739 (+ 3979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.824359 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.824475 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:36.830114 (+ 5639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:41277: BlockingRecv error: recv got EOF from 127.12.145.3:41277 (error 108)
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":279,"threads_started":1}
Aug 11 06:50:36 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:36 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:36.898394 28500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:36.889211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:40047)
0811 06:50:36.889793 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:36.889809 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:36.889979 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:36.890328 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:36.890332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:36.890759 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:36.890943 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:36.890952 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.892028 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.892032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:36.893064 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:36.893076 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.893855 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.893861 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:36.894024 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:36.894617 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:36.894636 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:36.898044 (+ 3408us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":317,"threads_started":1}
W20260811 06:50:36.898495 28499 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:36.889372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:40047 (local address 127.12.145.62:40415)
0811 06:50:36.889695 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:36.889701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:36.889929 (+ 228us) server_negotiation.cc:407] Connection header received
0811 06:50:36.890103 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:36.890108 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:36.890175 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:36.890257 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:36.891099 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.891881 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.893210 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:36.893700 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:36.893812 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:36.898266 (+ 4454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:40047: BlockingRecv error: recv got EOF from 127.12.145.1:40047 (error 108)
Metrics: {"server-negotiator.queue_time_us":168}
Aug 11 06:50:37 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:37 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:37.119504 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:37.110047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:39289)
0811 06:50:37.110831 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:37.110855 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:37.111009 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:37.111389 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:37.111394 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:37.111856 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:37.112046 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:37.112057 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.113169 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.113176 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:37.114318 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:37.114333 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.115070 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.115075 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:37.115220 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:37.115832 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:37.115852 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:37.119220 (+ 3368us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":480,"threads_started":1}
W20260811 06:50:37.119630 28499 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:37.110140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:39289 (local address 127.12.145.62:40415)
0811 06:50:37.110372 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:37.110379 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:37.110957 (+ 578us) server_negotiation.cc:407] Connection header received
0811 06:50:37.111153 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:37.111158 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:37.111225 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:37.111317 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:37.112208 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.113013 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.114471 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.114930 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.115045 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:37.119411 (+ 4366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:39289: BlockingRecv error: recv got EOF from 127.12.145.2:39289 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 06:50:37 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:37 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:37.840075 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:37.831349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:41195)
0811 06:50:37.831868 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:37.831893 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:37.832022 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:37.832314 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:37.832318 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:37.832704 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:37.832874 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:37.832884 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.833886 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.833890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:37.834881 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:37.834893 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.835515 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.835520 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:37.835660 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:37.836217 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:37.836234 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:37.839701 (+ 3467us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":371,"threads_started":1}
W20260811 06:50:37.840176 28508 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:37.831418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:41195 (local address 127.12.145.62:40415)
0811 06:50:37.831860 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:37.831864 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:37.831966 (+ 102us) server_negotiation.cc:407] Connection header received
0811 06:50:37.832108 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:37.832112 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:37.832185 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:37.832271 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:37.832995 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.833783 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.834982 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.835391 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.835484 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:37.839926 (+ 4442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:41195: BlockingRecv error: recv got EOF from 127.12.145.3:41195 (error 108)
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":242,"threads_started":1}
Aug 11 06:50:37 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:37 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:37.907684 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:37.899316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:38035)
0811 06:50:37.899854 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:37.899874 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:37.900015 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:37.900333 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:37.900338 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:37.900760 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:37.900939 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:37.900949 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.902010 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.902014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:37.902961 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:37.902973 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.903644 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.903650 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:37.903823 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:37.904357 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:37.904374 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:37.907381 (+ 3007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":294,"threads_started":1}
W20260811 06:50:37.907819 28508 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:37.899413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:38035 (local address 127.12.145.62:40415)
0811 06:50:37.899651 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:37.899659 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:37.899969 (+ 310us) server_negotiation.cc:407] Connection header received
0811 06:50:37.900131 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:37.900137 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:37.900203 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:37.900286 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:37.901088 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.901881 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.903108 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:37.903494 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:37.903603 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:37.907598 (+ 3995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:38035: BlockingRecv error: recv got EOF from 127.12.145.1:38035 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 11 06:50:38 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:38 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:38.129458 28510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:38.120481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:57425)
0811 06:50:38.121237 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:38.121253 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:38.121405 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:38.121806 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:38.121810 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:38.122332 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:38.122504 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:38.122515 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.123516 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.123520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:38.124458 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:38.124471 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.125166 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.125172 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:38.125343 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:38.125943 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:38.125963 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:38.129209 (+ 3246us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":300,"threads_started":1}
W20260811 06:50:38.129662 28508 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:38.120831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:57425 (local address 127.12.145.62:40415)
0811 06:50:38.121038 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:38.121042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:38.121355 (+ 313us) server_negotiation.cc:407] Connection header received
0811 06:50:38.121562 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:38.121567 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:38.121667 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:38.121766 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:38.122630 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.123391 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.124566 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.124991 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.125088 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:38.129396 (+ 4308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:57425: BlockingRecv error: recv got EOF from 127.12.145.2:57425 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 06:50:38 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:38 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:38.853274 28511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:38.840958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:48777)
0811 06:50:38.841562 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:38.841589 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:38.841705 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:38.842063 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:38.842066 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:38.842513 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:38.842663 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:38.842672 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.843608 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.843612 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:38.844553 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:38.844564 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.845166 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.845169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:38.845282 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:38.849145 (+ 3863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:38.849165 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:38.852939 (+ 3774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":287,"threads_started":1}
W20260811 06:50:38.853536 28512 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:38.841100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:48777 (local address 127.12.145.62:40415)
0811 06:50:38.841809 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:38.841814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:38.841829 (+ 15us) server_negotiation.cc:407] Connection header received
0811 06:50:38.841873 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:38.841877 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:38.841941 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:38.842027 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:38.842777 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.843491 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.844659 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.845060 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.845151 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:38.853250 (+ 8099us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:48777: BlockingRecv error: recv got EOF from 127.12.145.3:48777 (error 108)
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":491,"threads_started":1}
Aug 11 06:50:38 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:38 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:38.917615 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:38.908725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:41127)
0811 06:50:38.909276 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:38.909295 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:38.909419 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:38.909742 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:38.909745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:38.910170 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:38.910343 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:38.910352 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.911599 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.911605 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:38.912671 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:38.912685 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.913331 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.913335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:38.913453 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:38.914056 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:38.914073 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:38.917318 (+ 3245us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":311,"threads_started":1}
W20260811 06:50:38.917754 28512 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:38.908832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:41127 (local address 127.12.145.62:40415)
0811 06:50:38.909042 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:38.909047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:38.909398 (+ 351us) server_negotiation.cc:407] Connection header received
0811 06:50:38.909548 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:38.909552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:38.909626 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:38.909721 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:38.910503 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.911460 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.912795 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:38.913216 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:38.913313 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:38.917570 (+ 4257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:41127: BlockingRecv error: recv got EOF from 127.12.145.1:41127 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 06:50:39 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:39 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:39.139047 28517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:39.130450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:60799)
0811 06:50:39.130925 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:39.130943 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:39.131063 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:39.131375 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:39.131378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:39.131797 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:39.131977 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:39.131987 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.133022 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.133026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:39.134015 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:39.134028 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.134718 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.134721 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:39.134849 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:39.135426 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:39.135444 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:39.138808 (+ 3364us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":249,"threads_started":1}
W20260811 06:50:39.139385 28512 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:39.130502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:60799 (local address 127.12.145.62:40415)
0811 06:50:39.130728 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:39.130735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:39.131026 (+ 291us) server_negotiation.cc:407] Connection header received
0811 06:50:39.131169 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:39.131172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:39.131255 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:39.131346 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:39.132101 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.132905 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.134138 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.134592 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.134701 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:39.139070 (+ 4369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:60799: BlockingRecv error: recv got EOF from 127.12.145.2:60799 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 11 06:50:39 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:39 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:39.862715 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:39.854273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:43503)
0811 06:50:39.854759 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:39.854781 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:39.854889 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:39.855159 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:39.855162 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:39.855588 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:39.855754 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:39.855762 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.856697 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.856700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:39.857660 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:39.857672 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.858280 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.858284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:39.858401 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:39.858936 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:39.858953 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:39.862420 (+ 3467us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":248,"threads_started":1}
W20260811 06:50:39.862978 28519 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:39.854342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:43503 (local address 127.12.145.62:40415)
0811 06:50:39.854831 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:39.854836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:39.854852 (+ 16us) server_negotiation.cc:407] Connection header received
0811 06:50:39.854981 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:39.854984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:39.855045 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:39.855130 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:39.855866 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.856588 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.857763 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.858166 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.858254 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:39.862694 (+ 4440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:43503: BlockingRecv error: recv got EOF from 127.12.145.3:43503 (error 108)
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":266,"threads_started":1}
Aug 11 06:50:39 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:39 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:39.927493 28521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:39.918532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:39541)
0811 06:50:39.919156 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:39.919173 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:39.919293 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:39.919566 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:39.919569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:39.920002 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:39.920190 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:39.920200 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.921344 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.921350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:39.922548 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:39.922562 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.923198 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.923202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:39.923313 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:39.923865 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:39.923883 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:39.927220 (+ 3337us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":282,"threads_started":1}
W20260811 06:50:39.927598 28519 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:39.918646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:39541 (local address 127.12.145.62:40415)
0811 06:50:39.918810 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:39.918815 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:39.919238 (+ 423us) server_negotiation.cc:407] Connection header received
0811 06:50:39.919379 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:39.919383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:39.919444 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:39.919533 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:39.920324 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.921183 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.922672 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:39.923084 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:39.923177 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:39.927408 (+ 4231us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:39541: BlockingRecv error: recv got EOF from 127.12.145.1:39541 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 06:50:40 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:40 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:40.149998 28525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:40.139976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:32941)
0811 06:50:40.140614 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:40.140634 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:40.140789 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:40.141206 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:40.141211 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:40.141749 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:40.141948 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:40.141959 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.143060 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.143065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:40.144264 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:40.144278 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.145046 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.145054 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:40.145235 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:40.145902 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:40.145922 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:40.149741 (+ 3819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":295,"threads_started":1}
W20260811 06:50:40.150214 28519 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:40.140079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:32941 (local address 127.12.145.62:40415)
0811 06:50:40.140336 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:40.140343 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:40.140732 (+ 389us) server_negotiation.cc:407] Connection header received
0811 06:50:40.140955 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:40.140961 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:40.141051 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:40.141163 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:40.142115 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.142897 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.144425 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.144879 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.145005 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:40.149955 (+ 4950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:32941: BlockingRecv error: recv got EOF from 127.12.145.2:32941 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
Aug 11 06:50:40 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:40 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:40.872279 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:40.863725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:37573)
0811 06:50:40.864507 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:40.864532 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:40.864652 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:40.864927 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:40.864930 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:40.865357 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:40.865564 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:40.865575 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.866545 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.866548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:40.867493 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:40.867503 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.868127 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.868131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:40.868241 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:40.868787 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:40.868804 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:40.872033 (+ 3229us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":464,"threads_started":1}
W20260811 06:50:40.872467 28526 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:40.863790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:37573 (local address 127.12.145.62:40415)
0811 06:50:40.864284 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:40.864289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:40.864602 (+ 313us) server_negotiation.cc:407] Connection header received
0811 06:50:40.864741 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:40.864745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:40.864807 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:40.864897 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:40.865680 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.866436 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.867595 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.868016 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.868105 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:40.872237 (+ 4132us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:37573: BlockingRecv error: recv got EOF from 127.12.145.3:37573 (error 108)
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":262,"threads_started":1}
Aug 11 06:50:40 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:40 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:40.937949 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:40.928465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:35603)
0811 06:50:40.929069 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:40.929088 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:40.929214 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:40.929547 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:40.929552 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:40.929960 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:40.930170 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:40.930180 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.931191 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.931194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:40.932123 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:40.932136 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.932917 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.932924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:40.933089 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:40.933938 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:40.933961 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:40.937611 (+ 3650us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":289,"threads_started":1}
W20260811 06:50:40.938069 28526 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:40.928689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:35603 (local address 127.12.145.62:40415)
0811 06:50:40.928914 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:40.928919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:40.929160 (+ 241us) server_negotiation.cc:407] Connection header received
0811 06:50:40.929340 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:40.929343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:40.929412 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:40.929494 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:40.930302 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.931071 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.932280 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:40.932713 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:40.932820 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:40.937823 (+ 5003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:35603: BlockingRecv error: recv got EOF from 127.12.145.1:35603 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 06:50:41 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:41 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:41.159875 28531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:41.150902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:59183)
0811 06:50:41.151409 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:41.151426 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:41.151552 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:41.151872 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:41.151875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:41.152302 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:41.152487 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:41.152496 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.153756 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.153760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:41.154697 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:41.154710 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.155339 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.155343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:41.155472 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:41.156097 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:41.156115 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:41.159626 (+ 3511us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":246,"threads_started":1}
W20260811 06:50:41.160044 28526 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:41.151005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:59183 (local address 127.12.145.62:40415)
0811 06:50:41.151177 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:41.151182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:41.151495 (+ 313us) server_negotiation.cc:407] Connection header received
0811 06:50:41.151658 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:41.151662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:41.151745 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:41.151834 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:41.152601 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.153633 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.154804 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.155205 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.155294 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:41.159818 (+ 4524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:59183: BlockingRecv error: recv got EOF from 127.12.145.2:59183 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 06:50:41 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:41 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:41.881837 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:41.873185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:40275)
0811 06:50:41.873746 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:41.873767 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:41.873871 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:41.874160 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:41.874163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:41.874574 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:41.874739 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:41.874748 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.875715 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.875719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:41.876644 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:41.876654 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.877391 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.877395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:41.877543 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:41.878211 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:41.878233 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:41.881596 (+ 3363us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":274,"threads_started":1}
W20260811 06:50:41.882017 28533 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:41.873249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:40275 (local address 127.12.145.62:40415)
0811 06:50:41.873826 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:41.873830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:41.873849 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:50:41.873970 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:41.873973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:41.874042 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:41.874128 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:41.874882 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.875597 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.876774 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.877241 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.877337 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:41.881791 (+ 4454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:40275: BlockingRecv error: recv got EOF from 127.12.145.3:40275 (error 108)
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":309,"threads_started":1}
Aug 11 06:50:41 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:41 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:41.947592 28534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:41.938873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:53653)
0811 06:50:41.939385 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:41.939420 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:41.939560 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:41.939882 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:41.939886 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:41.940295 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:41.940449 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:41.940458 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.941586 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.941590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:41.942523 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:41.942534 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.943165 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.943169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:41.943287 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:41.943808 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:41.943823 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:41.947276 (+ 3453us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":286,"threads_started":1}
W20260811 06:50:41.947739 28533 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:41.938939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:53653 (local address 127.12.145.62:40415)
0811 06:50:41.939100 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:41.939105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:41.939492 (+ 387us) server_negotiation.cc:407] Connection header received
0811 06:50:41.939686 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:41.939691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:41.939767 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:41.939848 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:41.940621 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.941440 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.942642 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:41.943053 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:41.943144 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:41.947490 (+ 4346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:53653: BlockingRecv error: recv got EOF from 127.12.145.1:53653 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 06:50:42 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:42 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:42.169863 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:42.160838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:60553)
0811 06:50:42.161365 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:42.161381 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:42.161501 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:42.161981 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:42.161986 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:42.162461 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:42.162625 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:42.162635 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.163846 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.163850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:42.164795 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:42.164807 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.165492 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.165496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:42.165657 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:42.166175 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:42.166191 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:42.169541 (+ 3350us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":272,"threads_started":1}
W20260811 06:50:42.170020 28533 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:42.160943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:60553 (local address 127.12.145.62:40415)
0811 06:50:42.161137 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:42.161143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:42.161473 (+ 330us) server_negotiation.cc:407] Connection header received
0811 06:50:42.161657 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:42.161662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:42.161769 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:42.161924 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:42.162767 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.163723 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.164932 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.165373 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.165463 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:42.169770 (+ 4307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:60553: BlockingRecv error: recv got EOF from 127.12.145.2:60553 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 06:50:42 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:42 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:42.894436 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:42.882848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:33099)
0811 06:50:42.885286 (+ 2438us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:42.885651 (+ 365us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:42.885827 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:42.886357 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:42.886363 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:42.886779 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:42.886932 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:42.886941 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.887986 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.887990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:42.888920 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:42.888931 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.889688 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.889695 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:42.889871 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:42.890509 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:42.890526 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:42.894125 (+ 3599us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2274,"thread_start_us":2125,"threads_started":1}
W20260811 06:50:42.894606 28539 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:42.882991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:33099 (local address 127.12.145.62:40415)
0811 06:50:42.884815 (+ 1824us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:42.884822 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:42.885761 (+ 939us) server_negotiation.cc:407] Connection header received
0811 06:50:42.885953 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:42.885958 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:42.886061 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:42.886159 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:42.887087 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.887828 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.889069 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.889503 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.889657 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:42.894350 (+ 4693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:33099: BlockingRecv error: recv got EOF from 127.12.145.3:33099 (error 108)
Metrics: {"server-negotiator.queue_time_us":1677,"thread_start_us":1506,"threads_started":1}
Aug 11 06:50:42 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:42 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:42.957314 28541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:42.948770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:40975)
0811 06:50:42.949273 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:42.949289 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:42.949431 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:42.949767 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:42.949771 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:42.950169 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:42.950349 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:42.950359 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.951383 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.951387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:42.952425 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:42.952437 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.953120 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.953124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:42.953247 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:42.953808 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:42.953826 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:42.957052 (+ 3226us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":275,"threads_started":1}
W20260811 06:50:42.957544 28539 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:42.948913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:40975 (local address 127.12.145.62:40415)
0811 06:50:42.949134 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:42.949140 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:42.949393 (+ 253us) server_negotiation.cc:407] Connection header received
0811 06:50:42.949554 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:42.949558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:42.949638 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:42.949740 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:42.950488 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.951241 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.952536 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:42.952987 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:42.953079 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:42.957290 (+ 4211us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:40975: BlockingRecv error: recv got EOF from 127.12.145.1:40975 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 06:50:43 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:43 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:43.179942 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:43.170934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:42305)
0811 06:50:43.171445 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:43.171462 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:43.171595 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:43.171927 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:43.171932 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:43.172340 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:43.172507 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:43.172517 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.173585 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.173589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:43.174571 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:43.174583 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.175415 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.175422 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:43.175591 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:43.176312 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:43.176341 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:43.179700 (+ 3359us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":286,"threads_started":1}
W20260811 06:50:43.180169 28539 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:43.171003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:42305 (local address 127.12.145.62:40415)
0811 06:50:43.171200 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:43.171205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:43.171546 (+ 341us) server_negotiation.cc:407] Connection header received
0811 06:50:43.171709 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:43.171714 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:43.171790 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:43.171871 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:43.172674 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.173407 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.174716 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.175236 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.175359 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:43.179912 (+ 4553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:42305: BlockingRecv error: recv got EOF from 127.12.145.2:42305 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 06:50:43 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:43 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:43.906996 28543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:43.895321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:53857)
0811 06:50:43.895865 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:43.895892 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:43.896020 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:43.896285 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:43.896288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:43.896669 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:43.896857 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:43.896866 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.897938 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.897942 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:43.898935 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:43.898946 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.899646 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.899650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:43.899762 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:43.903062 (+ 3300us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:43.903081 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:43.906678 (+ 3597us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":258,"threads_started":1}
W20260811 06:50:43.907265 28545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:43.895510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:53857 (local address 127.12.145.62:40415)
0811 06:50:43.896019 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:43.896024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:43.896041 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:50:43.896110 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:43.896113 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:43.896171 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:43.896254 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:43.897006 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.897831 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.899070 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.899522 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.899620 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:43.906981 (+ 7361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:53857: BlockingRecv error: recv got EOF from 127.12.145.3:53857 (error 108)
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":271,"threads_started":1}
Aug 11 06:50:43 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:43 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:43.967828 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:43.958564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:34833)
0811 06:50:43.959086 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:43.959102 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:43.959225 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:43.959510 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:43.959513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:43.959928 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:43.960131 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:43.960140 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.961176 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.961179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:43.962142 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:43.962155 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.962828 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.962833 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:43.962955 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:43.963546 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:43.963564 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:43.967516 (+ 3952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":290,"threads_started":1}
W20260811 06:50:43.967917 28545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:43.958675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:34833 (local address 127.12.145.62:40415)
0811 06:50:43.958881 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:43.958887 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:43.959184 (+ 297us) server_negotiation.cc:407] Connection header received
0811 06:50:43.959338 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:43.959342 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:43.959407 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:43.959479 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:43.960275 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.961047 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.962261 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:43.962695 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:43.962789 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:43.967740 (+ 4951us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:34833: BlockingRecv error: recv got EOF from 127.12.145.1:34833 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 06:50:44 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:44 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:44.189620 28547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:44.180841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:50335)
0811 06:50:44.181367 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:44.181388 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:44.181508 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:44.181896 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:44.181900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:44.182433 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:44.182679 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:44.182690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.183701 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.183707 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:44.184619 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:44.184630 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.185330 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.185335 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:44.185540 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:44.186087 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:44.186104 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:44.189360 (+ 3256us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":322,"threads_started":1}
W20260811 06:50:44.189798 28545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:44.180971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:50335 (local address 127.12.145.62:40415)
0811 06:50:44.181165 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:44.181172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:44.181465 (+ 293us) server_negotiation.cc:407] Connection header received
0811 06:50:44.181644 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:44.181649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:44.181747 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:44.181835 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:44.182820 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.183569 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.184762 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.185176 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.185291 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:44.189555 (+ 4264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:50335: BlockingRecv error: recv got EOF from 127.12.145.2:50335 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 06:50:44 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:44 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:44.916965 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:44.908001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:38073)
0811 06:50:44.908458 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:44.908483 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:44.908590 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:44.909086 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:44.909089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:44.909561 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:44.909820 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:44.909835 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.911044 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.911048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:44.911971 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:44.911983 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.912655 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.912660 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:44.912791 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:44.913376 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:44.913394 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:44.916748 (+ 3354us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":240,"threads_started":1}
W20260811 06:50:44.917132 28554 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:44.908101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:38073 (local address 127.12.145.62:40415)
0811 06:50:44.908838 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:44.908844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:44.908861 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:50:44.908904 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:44.908907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:44.908970 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:44.909055 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:44.909965 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.910901 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.912099 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.912522 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.912611 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:44.916932 (+ 4321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:38073: BlockingRecv error: recv got EOF from 127.12.145.3:38073 (error 108)
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":479,"threads_started":1}
Aug 11 06:50:44 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:44 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:44.977422 28556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:44.968908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:54203)
0811 06:50:44.969453 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:44.969470 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:44.969629 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:44.969899 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:44.969902 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:44.970302 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:44.970478 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:44.970487 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.971599 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.971603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:44.972559 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:44.972570 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.973291 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.973295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:44.973422 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:44.974002 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:44.974018 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:44.977183 (+ 3165us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":281,"threads_started":1}
W20260811 06:50:44.977643 28554 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:44.968926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:54203 (local address 127.12.145.62:40415)
0811 06:50:44.969083 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:44.969088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:44.969539 (+ 451us) server_negotiation.cc:407] Connection header received
0811 06:50:44.969725 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:44.969729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:44.969791 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:44.969888 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:44.970655 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.971487 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.972717 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:44.973135 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:44.973233 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:44.977387 (+ 4154us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:54203: BlockingRecv error: recv got EOF from 127.12.145.1:54203 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 06:50:45 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:45 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:45.199599 28557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:45.190639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:53511)
0811 06:50:45.191248 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:45.191265 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:45.191380 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:45.191655 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:45.191658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:45.192090 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:45.192263 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:45.192272 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.193446 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.193450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:45.194406 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:45.194418 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.195201 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.195205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:45.195330 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:45.195943 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:45.195961 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:45.199345 (+ 3384us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":312,"threads_started":1}
W20260811 06:50:45.199759 28554 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:45.190708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:53511 (local address 127.12.145.62:40415)
0811 06:50:45.190972 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:45.190980 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:45.191344 (+ 364us) server_negotiation.cc:407] Connection header received
0811 06:50:45.191469 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:45.191473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:45.191547 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:45.191625 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:45.192387 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.193331 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.194551 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.195054 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.195163 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:45.199540 (+ 4377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:53511: BlockingRecv error: recv got EOF from 127.12.145.2:53511 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 06:50:45 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:45 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:45.926290 28558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:45.917837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:38759)
0811 06:50:45.918383 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:45.918404 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:45.918519 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:45.918834 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:45.918838 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:45.919248 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:45.919420 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:45.919429 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.920373 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.920377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:45.921308 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:45.921320 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.922009 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.922013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:45.922144 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:45.922675 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:45.922692 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:45.925930 (+ 3238us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":286,"threads_started":1}
W20260811 06:50:45.926455 28560 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:45.917885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:38759 (local address 127.12.145.62:40415)
0811 06:50:45.918414 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:45.918418 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:45.918477 (+ 59us) server_negotiation.cc:407] Connection header received
0811 06:50:45.918605 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:45.918608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:45.918667 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:45.918752 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:45.919526 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.920245 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.921410 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.921867 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.921956 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:45.926164 (+ 4208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:38759: BlockingRecv error: recv got EOF from 127.12.145.3:38759 (error 108)
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":284,"threads_started":1}
Aug 11 06:50:45 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:45 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:45.986655 28561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:45.978365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:39911)
0811 06:50:45.978842 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:45.978859 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:45.978978 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:45.979240 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:45.979243 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:45.979653 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:45.979812 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:45.979821 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.980718 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.980721 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:45.981679 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:45.981692 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.982301 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.982306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:45.982447 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:45.982988 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:45.983004 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:45.986423 (+ 3419us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":266,"threads_started":1}
W20260811 06:50:45.986784 28560 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:45.978433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:39911 (local address 127.12.145.62:40415)
0811 06:50:45.978650 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:45.978656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:45.978935 (+ 279us) server_negotiation.cc:407] Connection header received
0811 06:50:45.979066 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:45.979070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:45.979131 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:45.979207 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:45.979916 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.980608 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.981801 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:45.982193 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:45.982278 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:45.986611 (+ 4333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:39911: BlockingRecv error: recv got EOF from 127.12.145.1:39911 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 06:50:46 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:46 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:46.208684 28563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:46.200488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:44475)
0811 06:50:46.200964 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:46.200981 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:46.201093 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:46.201364 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:46.201367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:46.201795 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:46.201955 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:46.201964 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.202882 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.202885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:46.203784 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:46.203796 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.204386 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.204389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:46.204516 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:46.205029 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:46.205045 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:46.208380 (+ 3335us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":262,"threads_started":1}
W20260811 06:50:46.208822 28560 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:46.200672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:44475 (local address 127.12.145.62:40415)
0811 06:50:46.200921 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:46.200927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:46.201047 (+ 120us) server_negotiation.cc:407] Connection header received
0811 06:50:46.201179 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:46.201182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:46.201256 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:46.201332 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:46.202060 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.202778 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.203890 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.204282 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.204366 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:46.208607 (+ 4241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:44475: BlockingRecv error: recv got EOF from 127.12.145.2:44475 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 06:50:46 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:46 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.3@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:46.936476 28564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:46.927372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.3:55757)
0811 06:50:46.927869 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:46.927892 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:46.928001 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:46.928434 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:46.928437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:46.928865 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:46.929030 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:46.929039 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.930013 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.930017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:46.931000 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:46.931014 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.931702 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.931706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:46.931865 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:46.932399 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:46.932416 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:46.936231 (+ 3815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":243,"threads_started":1}
W20260811 06:50:46.936582 28565 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:46.927466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:55757 (local address 127.12.145.62:40415)
0811 06:50:46.928175 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:46.928179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:46.928195 (+ 16us) server_negotiation.cc:407] Connection header received
0811 06:50:46.928240 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:46.928243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:46.928301 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:46.928387 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:46.929139 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.929873 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.931129 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.931566 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.931658 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:46.936372 (+ 4714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.3:55757: BlockingRecv error: recv got EOF from 127.12.145.3:55757 (error 108)
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":445,"threads_started":1}
Aug 11 06:50:46 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:46 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.1@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:46.996907 28566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:46.987881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.1:43747)
0811 06:50:46.988410 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:46.988429 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:46.988556 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:46.988833 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:46.988836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:46.989232 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:46.989451 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:46.989461 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.990563 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.990568 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:46.991548 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:46.991561 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.992191 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.992196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:46.992345 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:46.992907 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:46.992924 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:46.996653 (+ 3729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":265,"threads_started":1}
W20260811 06:50:46.997042 28565 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:46.988002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:43747 (local address 127.12.145.62:40415)
0811 06:50:46.988316 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:46.988322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:46.988502 (+ 180us) server_negotiation.cc:407] Connection header received
0811 06:50:46.988649 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:46.988653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:46.988715 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:46.988791 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:46.989651 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.990395 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.991663 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:46.992059 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:46.992145 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:46.996845 (+ 4700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.1:43747: BlockingRecv error: recv got EOF from 127.12.145.1:43747 (error 108)
Metrics: {"server-negotiator.queue_time_us":166}
Aug 11 06:50:47 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 06:50:47 dist-test-slave-7lbf krb5kdc[26774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.2@KRBTEST.COM for oryx/127.12.145.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 06:50:47.219801 28568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:47.210205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:40415 (local address 127.12.145.2:36531)
0811 06:50:47.210738 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:47.210755 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:47.210876 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:47.211182 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:47.211184 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:47.211575 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:47.211765 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:47.211775 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:47.213073 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:47.213077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:47.214186 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:47.214202 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:47.215004 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:47.215011 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:47.215197 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:47.215805 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:47.215823 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:47.219447 (+ 3624us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.62:40415: Server oryx/127.12.145.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":253,"threads_started":1}
W20260811 06:50:47.220038 28565 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:47.210378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:36531 (local address 127.12.145.62:40415)
0811 06:50:47.210576 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:47.210584 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:47.210832 (+ 248us) server_negotiation.cc:407] Connection header received
0811 06:50:47.210968 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:47.210972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:47.211055 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:47.211150 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:47.211944 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:47.212918 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:47.214324 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:47.214801 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:47.214979 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:47.219729 (+ 4750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.2:36531: BlockingRecv error: recv got EOF from 127.12.145.2:36531 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:50:47.734826 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 27805
I20260811 06:50:47.747387 28572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:47.736001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60500 (local address 127.12.145.1:34353)
0811 06:50:47.736652 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:47.736660 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:47.736704 (+ 44us) server_negotiation.cc:407] Connection header received
0811 06:50:47.736791 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:47.736830 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:47.737116 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:47.737300 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:47.738787 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:47.739962 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:47.741227 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:47.741843 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:47.741953 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:47.744280 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:47.744289 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:47.744303 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:47.744345 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:47.746897 (+ 2552us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.145.1@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 06:50:47.747169 (+ 272us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60500: Request ticket server kudu/127.12.145.1@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":322,"threads_started":1}
W20260811 06:50:47.747491 28572 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60500: Request ticket server kudu/127.12.145.1@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 06:50:47.747635 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 27805: Not authorized: Client connection negotiation failed: client connection to 127.12.145.1:34353: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.145.1@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 06:50:47.747864 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 27805
I20260811 06:50:47.776443 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 28041
I20260811 06:50:47.788527 28574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:47.777655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36986 (local address 127.12.145.2:43995)
0811 06:50:47.778334 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:47.778344 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:47.778379 (+ 35us) server_negotiation.cc:407] Connection header received
0811 06:50:47.778466 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:47.778475 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:47.778783 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:47.779042 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:47.780233 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:47.781298 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:47.782479 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:47.783044 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:47.783142 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:47.785425 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:47.785433 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:47.785448 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:47.785491 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:47.788018 (+ 2527us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.145.2@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 06:50:47.788303 (+ 285us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36986: Request ticket server kudu/127.12.145.2@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":308,"threads_started":1}
W20260811 06:50:47.788628 28574 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36986: Request ticket server kudu/127.12.145.2@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 06:50:47.788657 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 28041: Not authorized: Client connection negotiation failed: client connection to 127.12.145.2:43995: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.145.2@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 06:50:47.788821 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 28041
I20260811 06:50:47.817488 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 28265
I20260811 06:50:47.830197 28575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:47.818799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46392 (local address 127.12.145.3:42459)
0811 06:50:47.819431 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:47.819438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:47.819464 (+ 26us) server_negotiation.cc:407] Connection header received
0811 06:50:47.819533 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:47.819539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:47.819803 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:47.820009 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:47.821419 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:47.822560 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:47.823806 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:47.824355 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:47.824481 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:47.827038 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:47.827046 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:47.827060 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:47.827110 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:47.829504 (+ 2394us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.145.3@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 06:50:47.829884 (+ 380us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46392: Request ticket server kudu/127.12.145.3@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":313,"threads_started":1}
W20260811 06:50:47.830291 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 28265: Not authorized: Client connection negotiation failed: client connection to 127.12.145.3:42459: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.145.3@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 06:50:47.830304 28575 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46392: Request ticket server kudu/127.12.145.3@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 06:50:47.830443 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 28265
I20260811 06:50:47.858861 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 27698
I20260811 06:50:47.860258 27795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:47.977377 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 27698
2026-08-11T06:50:48Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21611 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T06:50:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:50:48Z Disabled control of system clock
I20260811 06:50:48.070356 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:46817
--webserver_interface=127.12.145.62
--webserver_port=0
--builtin_ntp_servers=127.12.145.20:37267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:46817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 06:50:48.408366 28584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:48.408682 28584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:48.408772 28584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:48.416076 28584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:50:48.416184 28584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:48.416242 28584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:48.416322 28584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:50:48.416375 28584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:50:48.425611 28584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:46817
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:46817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:48.426908 28584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:48.428712 28584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:48.440023 28591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:48.440071 28595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:48.440094 28598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:48.440980 28584 server_base.cc:1034] running on GCE node
I20260811 06:50:48.441725 28584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:48.443053 28584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:48.444248 28584 hybrid_clock.cc:648] HybridClock initialized: now 1786431048444203 us; error 40 us; skew 500 ppm
I20260811 06:50:48.444556 28584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:50:48.446751 28584 webserver.cc:460] Webserver started at http://127.12.145.62:42531/ using document root <none> and password file <none>
I20260811 06:50:48.447428 28584 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:48.447515 28584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:48.447793 28584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:48.450702 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "67a3c717620742a1af3788b0dd7c7cf2"
format_stamp: "Formatted at 2026-08-11 06:50:48 on dist-test-slave-7lbf"
server_key: "b81f10f063e0e51b34a1b5d5697b9047"
server_key_iv: "911c114191a524682a97c1ae8be94bf0"
server_key_version: "encryptionkey@0"
I20260811 06:50:48.451439 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "67a3c717620742a1af3788b0dd7c7cf2"
format_stamp: "Formatted at 2026-08-11 06:50:48 on dist-test-slave-7lbf"
server_key: "b81f10f063e0e51b34a1b5d5697b9047"
server_key_iv: "911c114191a524682a97c1ae8be94bf0"
server_key_version: "encryptionkey@0"
I20260811 06:50:48.456547 28584 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:50:48.459899 28607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:48.461253 28584 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:50:48.461412 28584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "67a3c717620742a1af3788b0dd7c7cf2"
format_stamp: "Formatted at 2026-08-11 06:50:48 on dist-test-slave-7lbf"
server_key: "b81f10f063e0e51b34a1b5d5697b9047"
server_key_iv: "911c114191a524682a97c1ae8be94bf0"
server_key_version: "encryptionkey@0"
I20260811 06:50:48.461683 28584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:48.477159 28584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:48.478044 28584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:48.478309 28584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:48.495113 28584 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:46817
I20260811 06:50:48.495134 28690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:46817 every 8 connection(s)
I20260811 06:50:48.496534 28584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:50:48.500263 28693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:48.506613 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 28584
I20260811 06:50:48.506803 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:50:48.507445 12868 external_mini_cluster.cc:1428] Setting key 92353ada49cacf311e8b9fff4351ba6d
I20260811 06:50:48.511025 28693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2: Bootstrap starting.
I20260811 06:50:48.515180 28693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:48.516485 28693 log.cc:824] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:48.519856 28693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2: No bootstrap required, opened a new log
I20260811 06:50:48.522962 28698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:48.509415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58056 (local address 127.12.145.62:46817)
0811 06:50:48.510569 (+ 1154us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:48.510584 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:48.510644 (+ 60us) server_negotiation.cc:407] Connection header received
0811 06:50:48.513006 (+ 2362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:48.513036 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:48.513672 (+ 636us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:48.514110 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:48.514652 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:48.516578 (+ 1926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:48.518289 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:48.519319 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:48.519526 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:48.520563 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:48.520571 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:48.520586 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:48.521113 (+ 527us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:48.521194 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:48.521215 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:48.521302 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:48.521603 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 06:50:48.521937 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":330,"threads_started":1}
I20260811 06:50:48.527743 28693 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a3c717620742a1af3788b0dd7c7cf2" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46817 } }
I20260811 06:50:48.528108 28693 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:48.528203 28693 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67a3c717620742a1af3788b0dd7c7cf2, State: Initialized, Role: FOLLOWER
I20260811 06:50:48.528770 28693 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a3c717620742a1af3788b0dd7c7cf2" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46817 } }
I20260811 06:50:48.529036 28693 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:50:48.529173 28693 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:50:48.529335 28693 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:48.531538 28693 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a3c717620742a1af3788b0dd7c7cf2" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46817 } }
I20260811 06:50:48.532029 28693 leader_election.cc:302] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67a3c717620742a1af3788b0dd7c7cf2; no voters:
I20260811 06:50:48.532593 28693 leader_election.cc:288] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:50:48.532759 28700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:48.533424 28700 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 67a3c717620742a1af3788b0dd7c7cf2, State: Running, Role: LEADER
I20260811 06:50:48.533958 28700 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a3c717620742a1af3788b0dd7c7cf2" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46817 } }
I20260811 06:50:48.534641 28693 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:50:48.536867 28704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67a3c717620742a1af3788b0dd7c7cf2. Latest consensus state: current_term: 1 leader_uuid: "67a3c717620742a1af3788b0dd7c7cf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a3c717620742a1af3788b0dd7c7cf2" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46817 } } }
I20260811 06:50:48.537278 28704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:48.541106 28703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67a3c717620742a1af3788b0dd7c7cf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a3c717620742a1af3788b0dd7c7cf2" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 46817 } } }
I20260811 06:50:48.542331 28703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2 [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:48.543165 28714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:50:48.547415 28714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:50:48.556042 28714 catalog_manager.cc:1347] Generated new cluster ID: 5e9bbee5f64040888b080c6357fe3cf2
I20260811 06:50:48.556169 28714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:50:48.567629 28714 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:50:48.568866 28714 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:50:48.574811 28714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67a3c717620742a1af3788b0dd7c7cf2: Generated new TSK 0
I20260811 06:50:48.575603 28714 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:50:48.586273 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46817
--builtin_ntp_servers=127.12.145.20:37267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 06:50:48.922931 28729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:48.923204 28729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:48.923331 28729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:48.930521 28729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:48.930644 28729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:48.930794 28729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:50:48.939925 28729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:48.941234 28729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:48.943074 28729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:48.955825 28737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:48.955778 28744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:48.956161 28740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:48.956770 28729 server_base.cc:1034] running on GCE node
I20260811 06:50:48.957340 28729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:48.958315 28729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:48.959522 28729 hybrid_clock.cc:648] HybridClock initialized: now 1786431048959480 us; error 42 us; skew 500 ppm
I20260811 06:50:48.959834 28729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:50:48.965287 28729 webserver.cc:460] Webserver started at http://127.12.145.1:38879/ using document root <none> and password file <none>
I20260811 06:50:48.966070 28729 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:48.966189 28729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:48.966532 28729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:48.969389 28729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "e43a11def3d04238b214fab33b9508e7"
format_stamp: "Formatted at 2026-08-11 06:50:48 on dist-test-slave-7lbf"
server_key: "2894f7587af0aca6ab15dc6bade9cf27"
server_key_iv: "7159ba625ee0c0170a4e059cc4bb9ded"
server_key_version: "encryptionkey@0"
I20260811 06:50:48.970242 28729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "e43a11def3d04238b214fab33b9508e7"
format_stamp: "Formatted at 2026-08-11 06:50:48 on dist-test-slave-7lbf"
server_key: "2894f7587af0aca6ab15dc6bade9cf27"
server_key_iv: "7159ba625ee0c0170a4e059cc4bb9ded"
server_key_version: "encryptionkey@0"
I20260811 06:50:48.975780 28729 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:50:48.979355 28754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:48.980666 28729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:50:48.980829 28729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "e43a11def3d04238b214fab33b9508e7"
format_stamp: "Formatted at 2026-08-11 06:50:48 on dist-test-slave-7lbf"
server_key: "2894f7587af0aca6ab15dc6bade9cf27"
server_key_iv: "7159ba625ee0c0170a4e059cc4bb9ded"
server_key_version: "encryptionkey@0"
I20260811 06:50:48.981043 28729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:49.006953 28729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:49.007829 28729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:49.008128 28729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:49.009130 28729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:49.010679 28729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:49.010769 28729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:49.010881 28729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:49.010969 28729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:49.041954 28729 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:39933
I20260811 06:50:49.042076 28955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:39933 every 8 connection(s)
I20260811 06:50:49.043308 28729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:50:49.045404 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 28729
I20260811 06:50:49.045634 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:50:49.046420 12868 external_mini_cluster.cc:1428] Setting key 02bedd7250da868c813ff64187c3e50d
I20260811 06:50:49.049023 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46817
--builtin_ntp_servers=127.12.145.20:37267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 06:50:49.055934 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:49.045792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:59623 (local address 127.12.145.62:46817)
0811 06:50:49.046263 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:49.046269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:49.047643 (+ 1374us) server_negotiation.cc:407] Connection header received
0811 06:50:49.049538 (+ 1895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:49.049544 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:49.049632 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:49.049741 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:49.050780 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.051728 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.053234 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.053791 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.053907 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:49.055161 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:49.055166 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:49.055170 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:49.055191 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:49.055240 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:49.055254 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:49.055332 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:49.055505 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 06:50:49.055598 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":224,"threads_started":1}
I20260811 06:50:49.056846 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:49.046402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:46817 (local address 127.12.145.1:59623)
0811 06:50:49.047479 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:49.047534 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:49.049250 (+ 1716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:49.049926 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:49.049934 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:49.050043 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:49.050613 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:49.050630 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.051863 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.051866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:49.053095 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:49.053110 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.054001 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.054006 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:49.054206 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:49.054845 (+ 639us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:50:49.054848 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:49.054889 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:50:49.054982 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:49.055339 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:49.055345 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:49.055350 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 06:50:49.055480 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 06:50:49.055775 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":304,"threads_started":1}
I20260811 06:50:49.058357 28957 heartbeater.cc:347] Connected to a master server at 127.12.145.62:46817
I20260811 06:50:49.058645 28957 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:49.059397 28957 heartbeater.cc:511] Master 127.12.145.62:46817 requested a full tablet report, sending...
I20260811 06:50:49.061750 28637 ts_manager.cc:194] Registered new tserver with Master: e43a11def3d04238b214fab33b9508e7 (127.12.145.1:39933)
I20260811 06:50:49.063750 28637 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.1:59623
W20260811 06:50:49.381114 28962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:49.381399 28962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:49.381496 28962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:49.388783 28962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:49.388890 28962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:49.389002 28962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:50:49.398139 28962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:49.399479 28962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:49.401273 28962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:49.413995 28973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:49.414017 28971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:49.414053 28969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:49.414602 28962 server_base.cc:1034] running on GCE node
I20260811 06:50:49.415266 28962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:49.416172 28962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:49.417375 28962 hybrid_clock.cc:648] HybridClock initialized: now 1786431049417318 us; error 51 us; skew 500 ppm
I20260811 06:50:49.417737 28962 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:50:49.419956 28962 webserver.cc:460] Webserver started at http://127.12.145.2:39255/ using document root <none> and password file <none>
I20260811 06:50:49.420682 28962 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:49.420786 28962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:49.421106 28962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:49.423975 28962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "e99d12733a45477eb82868635fa93ac2"
format_stamp: "Formatted at 2026-08-11 06:50:49 on dist-test-slave-7lbf"
server_key: "b038a901e657f8a3fd255e66fd013459"
server_key_iv: "e8ca811264e51ba47780b5edcd673868"
server_key_version: "encryptionkey@0"
I20260811 06:50:49.424747 28962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "e99d12733a45477eb82868635fa93ac2"
format_stamp: "Formatted at 2026-08-11 06:50:49 on dist-test-slave-7lbf"
server_key: "b038a901e657f8a3fd255e66fd013459"
server_key_iv: "e8ca811264e51ba47780b5edcd673868"
server_key_version: "encryptionkey@0"
I20260811 06:50:49.430042 28962 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 06:50:49.433684 28979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:49.435014 28962 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:50:49.435180 28962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "e99d12733a45477eb82868635fa93ac2"
format_stamp: "Formatted at 2026-08-11 06:50:49 on dist-test-slave-7lbf"
server_key: "b038a901e657f8a3fd255e66fd013459"
server_key_iv: "e8ca811264e51ba47780b5edcd673868"
server_key_version: "encryptionkey@0"
I20260811 06:50:49.435386 28962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:49.447383 28962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:49.448155 28962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:49.448429 28962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:49.449347 28962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:49.450834 28962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:49.450933 28962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:49.451038 28962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:49.451120 28962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:49.481710 28962 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:46281
I20260811 06:50:49.481768 29163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:46281 every 8 connection(s)
I20260811 06:50:49.483114 28962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:50:49.489262 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 28962
I20260811 06:50:49.489449 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:50:49.489897 12868 external_mini_cluster.cc:1428] Setting key 9a12832bcc7dd289d70f744cd72b1e73
I20260811 06:50:49.492919 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46817
--builtin_ntp_servers=127.12.145.20:37267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 06:50:49.496567 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:49.485680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:60857 (local address 127.12.145.62:46817)
0811 06:50:49.485889 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:49.485896 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:49.487271 (+ 1375us) server_negotiation.cc:407] Connection header received
0811 06:50:49.488996 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:49.489001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:49.489083 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:49.489170 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:49.490354 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.491343 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.493605 (+ 2262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.493980 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.494073 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:49.495711 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:49.495717 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:49.495722 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:49.495744 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:49.495789 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:49.495805 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:49.495894 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:49.496156 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 06:50:49.496255 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 06:50:49.497692 29168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:49.486221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:46817 (local address 127.12.145.2:60857)
0811 06:50:49.487111 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:49.487153 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:49.488732 (+ 1579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:49.489430 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:49.489439 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:49.489573 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:49.490182 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:49.490201 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.491485 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.491491 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:49.493428 (+ 1937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:49.493444 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.494200 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.494207 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:49.494501 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:49.495312 (+ 811us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:50:49.495315 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:49.495372 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:50:49.495491 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:49.495906 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:49.495916 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:49.495923 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 06:50:49.496097 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 06:50:49.496461 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":259,"threads_started":1}
I20260811 06:50:49.499212 29165 heartbeater.cc:347] Connected to a master server at 127.12.145.62:46817
I20260811 06:50:49.499534 29165 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:49.500408 29165 heartbeater.cc:511] Master 127.12.145.62:46817 requested a full tablet report, sending...
I20260811 06:50:49.501986 28637 ts_manager.cc:194] Registered new tserver with Master: e99d12733a45477eb82868635fa93ac2 (127.12.145.2:46281)
I20260811 06:50:49.502986 28637 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.2:60857
W20260811 06:50:49.824261 29169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:49.824558 29169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:49.824652 29169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:49.831758 29169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:49.831854 29169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:49.831966 29169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:50:49.841112 29169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:46817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:49.842424 29169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:49.844158 29169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:49.856362 29176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:49.856423 29182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:49.856419 29179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:49.857641 29169 server_base.cc:1034] running on GCE node
I20260811 06:50:49.858290 29169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:49.859232 29169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:49.860455 29169 hybrid_clock.cc:648] HybridClock initialized: now 1786431049860377 us; error 72 us; skew 500 ppm
I20260811 06:50:49.860764 29169 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:50:49.863077 29169 webserver.cc:460] Webserver started at http://127.12.145.3:42295/ using document root <none> and password file <none>
I20260811 06:50:49.863839 29169 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:49.863956 29169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:49.864346 29169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:49.867491 29169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "078c807eb9fb4ec1bfc0127f2f912e73"
format_stamp: "Formatted at 2026-08-11 06:50:49 on dist-test-slave-7lbf"
server_key: "49fab10e3934af43a269bd752504b993"
server_key_iv: "e24342cf1344f4047ae6a88b5c9f6ec2"
server_key_version: "encryptionkey@0"
I20260811 06:50:49.868373 29169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "078c807eb9fb4ec1bfc0127f2f912e73"
format_stamp: "Formatted at 2026-08-11 06:50:49 on dist-test-slave-7lbf"
server_key: "49fab10e3934af43a269bd752504b993"
server_key_iv: "e24342cf1344f4047ae6a88b5c9f6ec2"
server_key_version: "encryptionkey@0"
I20260811 06:50:49.873904 29169 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 06:50:49.877467 29195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:49.878839 29169 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:50:49.879002 29169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "078c807eb9fb4ec1bfc0127f2f912e73"
format_stamp: "Formatted at 2026-08-11 06:50:49 on dist-test-slave-7lbf"
server_key: "49fab10e3934af43a269bd752504b993"
server_key_iv: "e24342cf1344f4047ae6a88b5c9f6ec2"
server_key_version: "encryptionkey@0"
I20260811 06:50:49.879202 29169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:49.904868 29169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:49.905788 29169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:49.906097 29169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:49.907069 29169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:49.908535 29169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:49.908640 29169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:49.908748 29169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:49.908819 29169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:49.939167 29169 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:43969
I20260811 06:50:49.939232 29396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:43969 every 8 connection(s)
I20260811 06:50:49.940546 29169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:50:49.949676 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 29169
I20260811 06:50:49.949854 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:50:49.950321 12868 external_mini_cluster.cc:1428] Setting key 63d09b24131e85698843975f0f2e93b9
I20260811 06:50:49.952911 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:49.943126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:42021 (local address 127.12.145.62:46817)
0811 06:50:49.943335 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:49.943342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:49.944660 (+ 1318us) server_negotiation.cc:407] Connection header received
0811 06:50:49.946443 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:49.946447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:49.946517 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:49.946603 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:49.947601 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.948328 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.949990 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.950432 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.950571 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:49.952016 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:49.952020 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:49.952023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:49.952042 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:49.952081 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:49.952096 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:49.952186 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:49.952430 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 06:50:49.952537 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 06:50:49.953974 29399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:49.943642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:46817 (local address 127.12.145.3:42021)
0811 06:50:49.944513 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:49.944550 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:49.946212 (+ 1662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:49.946781 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:49.946789 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:49.946909 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:49.947470 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:49.947487 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.948478 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.948482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:49.949803 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:49.949820 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.950671 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.950678 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:49.950921 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:49.951647 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:50:49.951651 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:49.951702 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:50:49.951788 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:49.952199 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:49.952209 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:49.952218 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 06:50:49.952421 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 06:50:49.952751 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":261,"threads_started":1}
I20260811 06:50:49.955271 29397 heartbeater.cc:347] Connected to a master server at 127.12.145.62:46817
I20260811 06:50:49.955550 29397 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:49.956283 29397 heartbeater.cc:511] Master 127.12.145.62:46817 requested a full tablet report, sending...
I20260811 06:50:49.957638 28637 ts_manager.cc:194] Registered new tserver with Master: 078c807eb9fb4ec1bfc0127f2f912e73 (127.12.145.3:43969)
I20260811 06:50:49.958425 28637 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.3:42021
I20260811 06:50:49.965672 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 06:50:49.971596 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:49.970094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58068 (local address 127.12.145.62:46817)
0811 06:50:49.970254 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:49.970259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:49.970748 (+ 489us) server_negotiation.cc:407] Connection header received
0811 06:50:49.970888 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:49.970891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:49.970959 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:49.971040 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:49.971352 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58068: BlockingRecv error: recv got EOF from 127.0.0.1:58068 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 06:50:49.972266 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 28729
I20260811 06:50:49.979737 29411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:49.973176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41840 (local address 127.12.145.1:39933)
0811 06:50:49.973743 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:49.973750 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:49.973776 (+ 26us) server_negotiation.cc:407] Connection header received
0811 06:50:49.973831 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:49.973837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:49.974062 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:49.974179 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:49.974544 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.975558 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.976763 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:49.977393 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:49.977492 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:49.978491 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:49.978499 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:49.978512 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:49.979094 (+ 582us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:49.979138 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:49.979157 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:49.979242 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:49.979349 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 06:50:49.979456 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":273,"threads_started":1}
I20260811 06:50:49.980921 28948 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:50.062885 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 28729
I20260811 06:50:50.087201 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 28962
I20260811 06:50:50.095043 29415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:50.088108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59560 (local address 127.12.145.2:46281)
0811 06:50:50.088661 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:50.088669 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:50.088697 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:50:50.088758 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:50.088765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:50.088994 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:50.089147 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:50.089593 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:50.090611 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:50.091872 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:50.092448 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:50.092563 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:50.093616 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:50.093625 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:50.093639 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:50.094223 (+ 584us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:50.094273 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:50.094293 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:50.094415 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:50.094550 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 06:50:50.094712 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":271,"threads_started":1}
I20260811 06:50:50.096340 29159 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:50.176147 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 28962
I20260811 06:50:50.200423 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 29169
I20260811 06:50:50.208329 29418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:50.201538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33256 (local address 127.12.145.3:43969)
0811 06:50:50.202247 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:50.202254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:50.202286 (+ 32us) server_negotiation.cc:407] Connection header received
0811 06:50:50.202349 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:50.202356 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:50.202572 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:50.202700 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:50.203093 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:50.204142 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:50.205275 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:50.205896 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:50.205991 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:50.207004 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:50.207013 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:50.207027 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:50.207612 (+ 585us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:50.207668 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:50.207688 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:50.207787 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:50.207851 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 06:50:50.207961 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":399,"threads_started":1}
I20260811 06:50:50.209632 29384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:50.290337 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 29169
I20260811 06:50:50.316707 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 28584
I20260811 06:50:50.317963 28686 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:50.420372 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 28584
2026-08-11T06:50:50Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2432 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T06:50:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:50:50Z Disabled control of system clock
I20260811 06:50:50.503017 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:42335
--webserver_interface=127.12.145.62
--webserver_port=0
--builtin_ntp_servers=127.12.145.20:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:42335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 06:50:50.840015 29426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:50.840310 29426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:50.840399 29426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:50.847492 29426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:50:50.847594 29426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:50.847638 29426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:50.847694 29426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:50:50.847738 29426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:50:50.856654 29426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:42335
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:42335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:50.857961 29426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:50.859730 29426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:50.871071 29437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:50.871102 29433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:50.871160 29435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:50.871910 29426 server_base.cc:1034] running on GCE node
I20260811 06:50:50.872644 29426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:50.874047 29426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:50.875247 29426 hybrid_clock.cc:648] HybridClock initialized: now 1786431050875212 us; error 30 us; skew 500 ppm
I20260811 06:50:50.875597 29426 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:50:50.877914 29426 webserver.cc:460] Webserver started at http://127.12.145.62:36471/ using document root <none> and password file <none>
I20260811 06:50:50.878605 29426 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:50.878697 29426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:50.879011 29426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:50.881968 29426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "5c61e8a5f24b4e299632b974fde5d45b"
format_stamp: "Formatted at 2026-08-11 06:50:50 on dist-test-slave-7lbf"
server_key: "519a0a63a07cc7f233f364e4fedb35fb"
server_key_iv: "6c3f2edf5ce4cad49e4bcb672966b449"
server_key_version: "encryptionkey@0"
I20260811 06:50:50.882838 29426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "5c61e8a5f24b4e299632b974fde5d45b"
format_stamp: "Formatted at 2026-08-11 06:50:50 on dist-test-slave-7lbf"
server_key: "519a0a63a07cc7f233f364e4fedb35fb"
server_key_iv: "6c3f2edf5ce4cad49e4bcb672966b449"
server_key_version: "encryptionkey@0"
I20260811 06:50:50.888190 29426 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:50:50.891947 29454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:50.893358 29426 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 06:50:50.893568 29426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "5c61e8a5f24b4e299632b974fde5d45b"
format_stamp: "Formatted at 2026-08-11 06:50:50 on dist-test-slave-7lbf"
server_key: "519a0a63a07cc7f233f364e4fedb35fb"
server_key_iv: "6c3f2edf5ce4cad49e4bcb672966b449"
server_key_version: "encryptionkey@0"
I20260811 06:50:50.893810 29426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:50.899727 29426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:50.900570 29426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:50.900898 29426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:50.919443 29426 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:42335
I20260811 06:50:50.919476 29537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:42335 every 8 connection(s)
I20260811 06:50:50.920931 29426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:50:50.924654 29539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:50.928542 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 29426
I20260811 06:50:50.928741 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:50:50.929421 12868 external_mini_cluster.cc:1428] Setting key 7bb020498a56edd819d94eced4f11fd1
I20260811 06:50:50.935343 29539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b: Bootstrap starting.
I20260811 06:50:50.938442 29544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:50.931801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33474 (local address 127.12.145.62:42335)
0811 06:50:50.932892 (+ 1091us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:50.932907 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:50.932960 (+ 53us) server_negotiation.cc:407] Connection header received
0811 06:50:50.934765 (+ 1805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:50.934793 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:50.935223 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:50.935613 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:50.936702 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:50.936711 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:50.936724 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:50.936744 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:50.936819 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:50.936849 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:50.937076 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:50.937230 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 06:50:50.937498 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":407,"threads_started":1}
I20260811 06:50:50.938748 29539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:50.939844 29539 log.cc:824] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:50.942741 29539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b: No bootstrap required, opened a new log
I20260811 06:50:50.950344 29539 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c61e8a5f24b4e299632b974fde5d45b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42335 } }
I20260811 06:50:50.950690 29539 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:50.950771 29539 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c61e8a5f24b4e299632b974fde5d45b, State: Initialized, Role: FOLLOWER
I20260811 06:50:50.951252 29539 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c61e8a5f24b4e299632b974fde5d45b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42335 } }
I20260811 06:50:50.951455 29539 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:50:50.951552 29539 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:50:50.951678 29539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:50.953768 29539 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c61e8a5f24b4e299632b974fde5d45b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42335 } }
I20260811 06:50:50.954209 29539 leader_election.cc:302] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c61e8a5f24b4e299632b974fde5d45b; no voters:
I20260811 06:50:50.954753 29539 leader_election.cc:288] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:50:50.954897 29546 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:50.955569 29546 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [term 1 LEADER]: Becoming Leader. State: Replica: 5c61e8a5f24b4e299632b974fde5d45b, State: Running, Role: LEADER
I20260811 06:50:50.956116 29546 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c61e8a5f24b4e299632b974fde5d45b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42335 } }
I20260811 06:50:50.956775 29539 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:50:50.959993 29552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c61e8a5f24b4e299632b974fde5d45b. Latest consensus state: current_term: 1 leader_uuid: "5c61e8a5f24b4e299632b974fde5d45b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c61e8a5f24b4e299632b974fde5d45b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42335 } } }
I20260811 06:50:50.960398 29552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:50.960870 29551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c61e8a5f24b4e299632b974fde5d45b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c61e8a5f24b4e299632b974fde5d45b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42335 } } }
I20260811 06:50:50.961274 29551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:50.970676 29559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:50:50.975898 29559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:50:50.984822 29559 catalog_manager.cc:1347] Generated new cluster ID: bfa099e67f524a1293cddd8cc485a660
I20260811 06:50:50.984957 29559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:50:50.996126 29559 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:50:50.996599 29559 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:50:51.006273 29559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c61e8a5f24b4e299632b974fde5d45b: Generated new TSK 0
I20260811 06:50:51.007155 29559 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:50:51.012557 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42335
--builtin_ntp_servers=127.12.145.20:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 06:50:51.347235 29577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:51.347515 29577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:51.347644 29577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:51.354828 29577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:51.354938 29577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:51.355091 29577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:50:51.364248 29577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:51.365545 29577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:51.367267 29577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:51.379841 29592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:51.379910 29588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:51.379880 29589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:51.380630 29577 server_base.cc:1034] running on GCE node
I20260811 06:50:51.381279 29577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:51.382264 29577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:51.383469 29577 hybrid_clock.cc:648] HybridClock initialized: now 1786431051383413 us; error 46 us; skew 500 ppm
I20260811 06:50:51.383785 29577 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:50:51.386067 29577 webserver.cc:460] Webserver started at http://127.12.145.1:44051/ using document root <none> and password file <none>
I20260811 06:50:51.386749 29577 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:51.386849 29577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:51.387168 29577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:51.392639 29577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "b46cb6a673e545a680506c541f962b6e"
format_stamp: "Formatted at 2026-08-11 06:50:51 on dist-test-slave-7lbf"
server_key: "ebc4a8dd672d950c8bc14e446e195251"
server_key_iv: "c963bcaabb6709fc69bc475c6f1c9bbe"
server_key_version: "encryptionkey@0"
I20260811 06:50:51.393469 29577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "b46cb6a673e545a680506c541f962b6e"
format_stamp: "Formatted at 2026-08-11 06:50:51 on dist-test-slave-7lbf"
server_key: "ebc4a8dd672d950c8bc14e446e195251"
server_key_iv: "c963bcaabb6709fc69bc475c6f1c9bbe"
server_key_version: "encryptionkey@0"
I20260811 06:50:51.398804 29577 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 06:50:51.402326 29599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:51.403678 29577 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 06:50:51.403831 29577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "b46cb6a673e545a680506c541f962b6e"
format_stamp: "Formatted at 2026-08-11 06:50:51 on dist-test-slave-7lbf"
server_key: "ebc4a8dd672d950c8bc14e446e195251"
server_key_iv: "c963bcaabb6709fc69bc475c6f1c9bbe"
server_key_version: "encryptionkey@0"
I20260811 06:50:51.404059 29577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:51.409736 29577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:51.410498 29577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:51.410755 29577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:51.411623 29577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:51.412995 29577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:51.413091 29577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:51.413198 29577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:51.413265 29577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:51.442945 29577 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:40855
I20260811 06:50:51.442999 29794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:40855 every 8 connection(s)
I20260811 06:50:51.444207 29577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:50:51.451581 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 29577
I20260811 06:50:51.451777 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:50:51.452044 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:51.446711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:54665 (local address 127.12.145.62:42335)
0811 06:50:51.447182 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:51.447189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:51.448322 (+ 1133us) server_negotiation.cc:407] Connection header received
0811 06:50:51.449968 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:51.449972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:51.450026 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:51.450118 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:51.451315 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:51.451321 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:51.451326 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:51.451346 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:51.451398 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:51.451415 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:51.451547 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:51.451672 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 06:50:51.451739 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":222,"threads_started":1}
I20260811 06:50:51.452527 12868 external_mini_cluster.cc:1428] Setting key c1ee82f74d07bf26a1eb646e4433787b
I20260811 06:50:51.452884 29799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:51.447286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:42335 (local address 127.12.145.1:54665)
0811 06:50:51.448175 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:51.448211 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:51.449749 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:51.450300 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:51.450307 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:51.450392 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:51.451019 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:50:51.451021 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:51.451064 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:50:51.451145 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:51.451505 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:51.451511 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:51.451515 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 06:50:51.451723 (+ 208us) client_negotiation.cc:240] Negotiation successful
0811 06:50:51.451952 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":254,"threads_started":1}
I20260811 06:50:51.454316 29795 heartbeater.cc:347] Connected to a master server at 127.12.145.62:42335
I20260811 06:50:51.454600 29795 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:51.455138 29795 heartbeater.cc:511] Master 127.12.145.62:42335 requested a full tablet report, sending...
I20260811 06:50:51.455194 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42335
--builtin_ntp_servers=127.12.145.20:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 06:50:51.457357 29474 ts_manager.cc:194] Registered new tserver with Master: b46cb6a673e545a680506c541f962b6e (127.12.145.1:40855)
W20260811 06:50:51.782503 29800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:51.782768 29800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:51.782899 29800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:51.790002 29800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:51.790100 29800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:51.790248 29800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:50:51.799024 29800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:51.800278 29800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:51.802055 29800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:51.814424 29811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:51.814499 29814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:51.814527 29810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:51.815395 29800 server_base.cc:1034] running on GCE node
I20260811 06:50:51.815959 29800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:51.816885 29800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:51.818073 29800 hybrid_clock.cc:648] HybridClock initialized: now 1786431051818022 us; error 45 us; skew 500 ppm
I20260811 06:50:51.818369 29800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:50:51.820469 29800 webserver.cc:460] Webserver started at http://127.12.145.2:43357/ using document root <none> and password file <none>
I20260811 06:50:51.821128 29800 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:51.821230 29800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:51.821593 29800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:51.824432 29800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "60ab1e18362d48eda83b27ff1936f477"
format_stamp: "Formatted at 2026-08-11 06:50:51 on dist-test-slave-7lbf"
server_key: "7fa7f1592f93cdcb4788ebb33eb7f685"
server_key_iv: "dc90deaad103b005ff6e9201ea245253"
server_key_version: "encryptionkey@0"
I20260811 06:50:51.825196 29800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "60ab1e18362d48eda83b27ff1936f477"
format_stamp: "Formatted at 2026-08-11 06:50:51 on dist-test-slave-7lbf"
server_key: "7fa7f1592f93cdcb4788ebb33eb7f685"
server_key_iv: "dc90deaad103b005ff6e9201ea245253"
server_key_version: "encryptionkey@0"
I20260811 06:50:51.830168 29800 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 06:50:51.833483 29822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:51.834851 29800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:50:51.835003 29800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "60ab1e18362d48eda83b27ff1936f477"
format_stamp: "Formatted at 2026-08-11 06:50:51 on dist-test-slave-7lbf"
server_key: "7fa7f1592f93cdcb4788ebb33eb7f685"
server_key_iv: "dc90deaad103b005ff6e9201ea245253"
server_key_version: "encryptionkey@0"
I20260811 06:50:51.835206 29800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:51.840761 29800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:51.841588 29800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:51.841832 29800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:51.842713 29800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:51.844076 29800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:51.844167 29800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:51.844269 29800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:51.844336 29800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:51.874164 29800 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:39111
I20260811 06:50:51.874215 30024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:39111 every 8 connection(s)
I20260811 06:50:51.875470 29800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:50:51.882747 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 29800
I20260811 06:50:51.882947 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:50:51.883438 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:51.877892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:55373 (local address 127.12.145.62:42335)
0811 06:50:51.878061 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:51.878066 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:51.879435 (+ 1369us) server_negotiation.cc:407] Connection header received
0811 06:50:51.881125 (+ 1690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:51.881131 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:51.881212 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:51.881303 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:51.882643 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:51.882648 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:51.882652 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:51.882669 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:51.882702 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:51.882714 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:51.882836 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:51.883051 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 06:50:51.883126 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 06:50:51.883541 12868 external_mini_cluster.cc:1428] Setting key 558ddb7305b9e7e16da2c199149ddcaf
I20260811 06:50:51.884271 30028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:51.878374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:42335 (local address 127.12.145.2:55373)
0811 06:50:51.879270 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:51.879313 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:51.880845 (+ 1532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:51.881591 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:51.881599 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:51.881689 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:51.882313 (+ 624us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:50:51.882316 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:51.882374 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:50:51.882461 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:51.882800 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:51.882811 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:51.882819 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 06:50:51.883089 (+ 270us) client_negotiation.cc:240] Negotiation successful
0811 06:50:51.883293 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":255,"threads_started":1}
I20260811 06:50:51.885650 30025 heartbeater.cc:347] Connected to a master server at 127.12.145.62:42335
I20260811 06:50:51.885983 30025 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:51.886500 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42335
--builtin_ntp_servers=127.12.145.20:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 06:50:51.886732 30025 heartbeater.cc:511] Master 127.12.145.62:42335 requested a full tablet report, sending...
I20260811 06:50:51.888295 29473 ts_manager.cc:194] Registered new tserver with Master: 60ab1e18362d48eda83b27ff1936f477 (127.12.145.2:39111)
W20260811 06:50:52.215494 30030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:52.215766 30030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:52.215862 30030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:52.223033 30030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:52.223136 30030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:52.223253 30030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:50:52.232188 30030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:52.233506 30030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:52.235284 30030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:52.247632 30036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:52.247668 30039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:52.247571 30037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:52.248629 30030 server_base.cc:1034] running on GCE node
I20260811 06:50:52.249193 30030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:52.250128 30030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:52.251327 30030 hybrid_clock.cc:648] HybridClock initialized: now 1786431052251281 us; error 35 us; skew 500 ppm
I20260811 06:50:52.251621 30030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:50:52.253809 30030 webserver.cc:460] Webserver started at http://127.12.145.3:37091/ using document root <none> and password file <none>
I20260811 06:50:52.254459 30030 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:52.254565 30030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:52.254871 30030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:52.257751 30030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "084524d0bd0e44a19cea3a462fbc245e"
format_stamp: "Formatted at 2026-08-11 06:50:52 on dist-test-slave-7lbf"
server_key: "7957594013c8bafa0b2e37d08de525a5"
server_key_iv: "ea16ca95a1ea1e7f65164298f7b12599"
server_key_version: "encryptionkey@0"
I20260811 06:50:52.258546 30030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "084524d0bd0e44a19cea3a462fbc245e"
format_stamp: "Formatted at 2026-08-11 06:50:52 on dist-test-slave-7lbf"
server_key: "7957594013c8bafa0b2e37d08de525a5"
server_key_iv: "ea16ca95a1ea1e7f65164298f7b12599"
server_key_version: "encryptionkey@0"
I20260811 06:50:52.263564 30030 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:50:52.266885 30053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:52.268178 30030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 06:50:52.268329 30030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "084524d0bd0e44a19cea3a462fbc245e"
format_stamp: "Formatted at 2026-08-11 06:50:52 on dist-test-slave-7lbf"
server_key: "7957594013c8bafa0b2e37d08de525a5"
server_key_iv: "ea16ca95a1ea1e7f65164298f7b12599"
server_key_version: "encryptionkey@0"
I20260811 06:50:52.268535 30030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:52.273963 30030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:52.274721 30030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:52.274966 30030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:52.275868 30030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:52.277309 30030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:52.277406 30030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:52.277530 30030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:52.277603 30030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 06:50:52.306120 30030 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:37205
I20260811 06:50:52.306166 30265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:37205 every 8 connection(s)
I20260811 06:50:52.307478 30030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:50:52.314256 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 30030
I20260811 06:50:52.314424 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:50:52.314947 12868 external_mini_cluster.cc:1428] Setting key 537d736a39e290d021041dfaa7cf0f8f
I20260811 06:50:52.315543 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:52.310031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:55731 (local address 127.12.145.62:42335)
0811 06:50:52.310253 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:52.310260 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:52.311632 (+ 1372us) server_negotiation.cc:407] Connection header received
0811 06:50:52.313318 (+ 1686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:52.313323 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:52.313384 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:52.313471 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:52.314826 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:52.314832 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:52.314837 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:52.314858 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:52.314898 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:52.314914 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:52.315042 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:52.315201 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 06:50:52.315268 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 06:50:52.316529 30269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:52.310600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:42335 (local address 127.12.145.3:55731)
0811 06:50:52.311492 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:52.311529 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:52.313065 (+ 1536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:52.313708 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:52.313716 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:52.313804 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:52.314514 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:50:52.314517 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:52.314574 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:50:52.314661 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:52.315003 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:52.315011 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:52.315018 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 06:50:52.315245 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 06:50:52.315431 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":261,"threads_started":1}
I20260811 06:50:52.317854 30266 heartbeater.cc:347] Connected to a master server at 127.12.145.62:42335
I20260811 06:50:52.318189 30266 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:52.318812 30266 heartbeater.cc:511] Master 127.12.145.62:42335 requested a full tablet report, sending...
I20260811 06:50:52.320155 29474 ts_manager.cc:194] Registered new tserver with Master: 084524d0bd0e44a19cea3a462fbc245e (127.12.145.3:37205)
I20260811 06:50:52.330507 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 06:50:52.336639 29797 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:50:52.335188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33476 (local address 127.12.145.62:42335)
0811 06:50:52.335371 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:52.335376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:52.335872 (+ 496us) server_negotiation.cc:407] Connection header received
0811 06:50:52.336012 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:52.336016 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:52.336080 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:52.336160 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:52.336452 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33476: BlockingRecv error: recv got EOF from 127.0.0.1:33476 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 06:50:52.337169 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 29577
I20260811 06:50:52.340863 30281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:52.338184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50740 (local address 127.12.145.1:40855)
0811 06:50:52.338691 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:52.338700 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:52.338727 (+ 27us) server_negotiation.cc:407] Connection header received
0811 06:50:52.338782 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:52.338788 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:52.339016 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:52.339153 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:52.340161 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:52.340171 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:52.340187 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:52.340202 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:52.340252 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:52.340271 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:52.340387 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:52.340498 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 06:50:52.340613 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":207,"threads_started":1}
I20260811 06:50:52.342083 29787 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:52.421556 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 29577
I20260811 06:50:52.445996 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 29800
I20260811 06:50:52.449371 30283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:52.446948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33192 (local address 127.12.145.2:39111)
0811 06:50:52.447459 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:52.447467 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:52.447495 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:50:52.447558 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:52.447565 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:52.447774 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:52.447907 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:52.448759 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:52.448766 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:52.448779 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:52.448791 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:52.448838 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:52.448857 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:52.448964 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:52.449034 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 06:50:52.449120 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":227,"threads_started":1}
I20260811 06:50:52.450620 30017 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:52.530985 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 29800
I20260811 06:50:52.555106 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 30030
I20260811 06:50:52.559383 30288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:52.556179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58932 (local address 127.12.145.3:37205)
0811 06:50:52.556890 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:52.556898 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:52.556930 (+ 32us) server_negotiation.cc:407] Connection header received
0811 06:50:52.557021 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:52.557029 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:52.557306 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:52.557456 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:52.558641 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:52.558647 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:52.558659 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:50:52.558676 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:52.558714 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:50:52.558728 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:52.558890 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:52.558972 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 06:50:52.559075 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":372,"threads_started":1}
I20260811 06:50:52.560668 30258 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:52.646109 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 30030
I20260811 06:50:52.669726 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 29426
I20260811 06:50:52.670928 29532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:52.771806 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 29426
2026-08-11T06:50:52Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2353 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:50:52 dist-test-slave-7lbf krb5kdc[30295](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:50:52 dist-test-slave-7lbf krb5kdc[30295](info): set up 2 sockets
Aug 11 06:50:52 dist-test-slave-7lbf krb5kdc[30295](info): commencing operation
krb5kdc: starting...
W20260811 06:50:54.018190 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:50:54 dist-test-slave-7lbf krb5kdc[30295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:50:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:50:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:50:54.298543 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:45107
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:45107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:54.631224 30314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:54.631520 30314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:54.631613 30314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:54.638809 30314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:50:54.638919 30314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:54.638995 30314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:54.639078 30314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:50:54.639137 30314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:50:54.649004 30314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:45107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:45107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:54.650355 30314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:54.651679 30314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:54.663283 30331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:54.663371 30326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:54.663379 30329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:54.664556 30314 server_base.cc:1034] running on GCE node
I20260811 06:50:54.665380 30314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:54.666872 30314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:54.668092 30314 hybrid_clock.cc:648] HybridClock initialized: now 1786431054668041 us; error 37 us; skew 500 ppm
I20260811 06:50:54.668448 30314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:54 dist-test-slave-7lbf krb5kdc[30295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431054, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:54.674702 30314 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:50:54.676189 30314 webserver.cc:460] Webserver started at http://127.12.145.62:38421/ using document root <none> and password file <none>
I20260811 06:50:54.676868 30314 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:54.676987 30314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:54.677280 30314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:54.680226 30314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "f3b5d0f8905043dd92c690284f14e985"
format_stamp: "Formatted at 2026-08-11 06:50:54 on dist-test-slave-7lbf"
server_key: "ac140c5ce1bc1baf84bf78b9b5615d2c"
server_key_iv: "4f53efdbda2ecf441891c37a9b8701be"
server_key_version: "encryptionkey@0"
I20260811 06:50:54.681049 30314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "f3b5d0f8905043dd92c690284f14e985"
format_stamp: "Formatted at 2026-08-11 06:50:54 on dist-test-slave-7lbf"
server_key: "ac140c5ce1bc1baf84bf78b9b5615d2c"
server_key_iv: "4f53efdbda2ecf441891c37a9b8701be"
server_key_version: "encryptionkey@0"
I20260811 06:50:54.686257 30314 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 06:50:54.689740 30343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:54.691066 30314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:50:54.691228 30314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "f3b5d0f8905043dd92c690284f14e985"
format_stamp: "Formatted at 2026-08-11 06:50:54 on dist-test-slave-7lbf"
server_key: "ac140c5ce1bc1baf84bf78b9b5615d2c"
server_key_iv: "4f53efdbda2ecf441891c37a9b8701be"
server_key_version: "encryptionkey@0"
I20260811 06:50:54.691404 30314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:54.707365 30314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:54.711189 30314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:54.711454 30314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:54.728084 30314 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:45107
I20260811 06:50:54.728113 30433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:45107 every 8 connection(s)
I20260811 06:50:54.729370 30314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:50:54.732982 30434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:54.733716 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 30314
I20260811 06:50:54.733906 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:50:54.734543 12868 external_mini_cluster.cc:1428] Setting key 863e2676cb963185ae9552939f4b7706
I20260811 06:50:54.746420 30434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985: Bootstrap starting.
Aug 11 06:50:54 dist-test-slave-7lbf krb5kdc[30295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:50:54.750198 30434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:54.751297 30434 log.cc:824] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:54.754534 30434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985: No bootstrap required, opened a new log
I20260811 06:50:54.757404 30438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:54.736432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35186 (local address 127.12.145.62:45107)
0811 06:50:54.737181 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:54.737192 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:54.737236 (+ 44us) server_negotiation.cc:407] Connection header received
0811 06:50:54.738903 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:54.738926 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:54.739297 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:54.739614 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:54.741441 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:54.742737 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:54.744488 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:54.745157 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:54.745277 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:54.749924 (+ 4647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:54.749933 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:54.749947 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:54.749983 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:54.753238 (+ 3255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:54.754088 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:54.754094 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:54.754100 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:54.754270 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:54.754670 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:54.754674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:54.754676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:54.755216 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:54.755470 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:54.755915 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 06:50:54.756265 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":333,"threads_started":1}
I20260811 06:50:54.762499 30434 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b5d0f8905043dd92c690284f14e985" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45107 } }
I20260811 06:50:54.762830 30434 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:54.762946 30434 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3b5d0f8905043dd92c690284f14e985, State: Initialized, Role: FOLLOWER
I20260811 06:50:54.763502 30434 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b5d0f8905043dd92c690284f14e985" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45107 } }
I20260811 06:50:54.763720 30434 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:50:54.763839 30434 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:50:54.764003 30434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:54.766268 30434 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b5d0f8905043dd92c690284f14e985" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45107 } }
I20260811 06:50:54.766734 30434 leader_election.cc:302] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3b5d0f8905043dd92c690284f14e985; no voters:
I20260811 06:50:54.767311 30434 leader_election.cc:288] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:50:54.767448 30441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:54.768061 30441 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [term 1 LEADER]: Becoming Leader. State: Replica: f3b5d0f8905043dd92c690284f14e985, State: Running, Role: LEADER
I20260811 06:50:54.768580 30441 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b5d0f8905043dd92c690284f14e985" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45107 } }
I20260811 06:50:54.769272 30434 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:50:54.771431 30444 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3b5d0f8905043dd92c690284f14e985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b5d0f8905043dd92c690284f14e985" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45107 } } }
I20260811 06:50:54.771880 30444 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:54.771726 30445 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3b5d0f8905043dd92c690284f14e985. Latest consensus state: current_term: 1 leader_uuid: "f3b5d0f8905043dd92c690284f14e985" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b5d0f8905043dd92c690284f14e985" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45107 } } }
I20260811 06:50:54.772017 30445 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985 [sys.catalog]: This master's current role is: LEADER
I20260811 06:50:54.773934 30452 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:50:54.778450 30452 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:50:54.786887 30452 catalog_manager.cc:1347] Generated new cluster ID: 11de6d3439bb4c4488c13f99cf6f0b18
I20260811 06:50:54.787096 30452 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:50:54.810217 30452 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:50:54.812031 30452 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:50:54.819345 30452 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985: Generated new TSK 0
I20260811 06:50:54.820333 30452 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:50:54.885886 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45107
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:55.214234 30468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:55.214555 30468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:55.214715 30468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:55.222059 30468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:55.222169 30468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:55.222288 30468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:50:55.232208 30468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:55.233534 30468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:55.234814 30468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:55.247618 30474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:55.247706 30475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:55.247648 30479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:55.248353 30468 server_base.cc:1034] running on GCE node
I20260811 06:50:55.248961 30468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:55.249943 30468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:55.251150 30468 hybrid_clock.cc:648] HybridClock initialized: now 1786431055251099 us; error 43 us; skew 500 ppm
I20260811 06:50:55.251461 30468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:55 dist-test-slave-7lbf krb5kdc[30295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431055, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:55.254508 30468 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:50:55.255869 30468 webserver.cc:460] Webserver started at http://127.12.145.1:36941/ using document root <none> and password file <none>
I20260811 06:50:55.256582 30468 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:55.256695 30468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:55.256987 30468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:55.259871 30468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "aa8865099e6e4d5bb42be86ccbbb8626"
format_stamp: "Formatted at 2026-08-11 06:50:55 on dist-test-slave-7lbf"
server_key: "2a2a4a61b42530743b6e1f86fc3280dc"
server_key_iv: "c6ca2a033c774839acffaef48b70979a"
server_key_version: "encryptionkey@0"
I20260811 06:50:55.260632 30468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "aa8865099e6e4d5bb42be86ccbbb8626"
format_stamp: "Formatted at 2026-08-11 06:50:55 on dist-test-slave-7lbf"
server_key: "2a2a4a61b42530743b6e1f86fc3280dc"
server_key_iv: "c6ca2a033c774839acffaef48b70979a"
server_key_version: "encryptionkey@0"
I20260811 06:50:55.265722 30468 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260811 06:50:55.269009 30490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:55.270385 30468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:50:55.270550 30468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "aa8865099e6e4d5bb42be86ccbbb8626"
format_stamp: "Formatted at 2026-08-11 06:50:55 on dist-test-slave-7lbf"
server_key: "2a2a4a61b42530743b6e1f86fc3280dc"
server_key_iv: "c6ca2a033c774839acffaef48b70979a"
server_key_version: "encryptionkey@0"
I20260811 06:50:55.270720 30468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:55.293817 30468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:55.298002 30468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:55.298281 30468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:55.299244 30468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:55.300554 30468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:55.300631 30468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:55.300757 30468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:55.300812 30468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:55.329833 30468 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:45353
I20260811 06:50:55.329891 30680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:45353 every 8 connection(s)
I20260811 06:50:55.331103 30468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:50:55.333702 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 30468
I20260811 06:50:55.333899 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:50:55.334545 12868 external_mini_cluster.cc:1428] Setting key 0000604b9e0f1a5e114435acd618aaf6
Aug 11 06:50:55 dist-test-slave-7lbf krb5kdc[30295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431055, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:50:55.351934 30685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:55.333651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:56479 (local address 127.12.145.62:45107)
0811 06:50:55.335801 (+ 2150us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:55.335806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:55.335824 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:50:55.337482 (+ 1658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:55.337487 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:55.337584 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:55.337689 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:55.339118 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:55.340081 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:55.341872 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:55.342391 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:55.342534 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:55.345958 (+ 3424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:55.345964 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:55.345969 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:55.346008 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:55.348828 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:55.349725 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:55.349730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:55.349732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:55.349852 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:55.350287 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:55.350290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:55.350292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:55.350569 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:55.350679 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:55.351503 (+ 824us) server_negotiation.cc:299] Negotiation successful
0811 06:50:55.351677 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2031,"thread_start_us":1929,"threads_started":1}
I20260811 06:50:55.353314 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:55.334148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:45107 (local address 127.12.145.1:56479)
0811 06:50:55.335067 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:55.335128 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:55.337194 (+ 2066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:55.337884 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:55.337892 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:55.338397 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:55.338948 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:55.338966 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:55.340242 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:55.340246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:55.341724 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:55.341737 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:55.342601 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:55.342605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:55.342799 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:55.343420 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:55.343443 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:55.345724 (+ 2281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:55.348974 (+ 3250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:55.348983 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:55.349001 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:55.349613 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:55.349951 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:55.349956 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:55.349960 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:55.350190 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:55.350694 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:55.350701 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:55.351108 (+ 407us) client_negotiation.cc:769] Sending connection context
0811 06:50:55.351407 (+ 299us) client_negotiation.cc:240] Negotiation successful
0811 06:50:55.351977 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":339,"threads_started":1}
I20260811 06:50:55.354897 30681 heartbeater.cc:347] Connected to a master server at 127.12.145.62:45107
I20260811 06:50:55.355207 30681 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:55.355953 30681 heartbeater.cc:511] Master 127.12.145.62:45107 requested a full tablet report, sending...
I20260811 06:50:55.358034 30373 ts_manager.cc:194] Registered new tserver with Master: aa8865099e6e4d5bb42be86ccbbb8626 (127.12.145.1:45353)
I20260811 06:50:55.359495 30373 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:56479
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:50:55.397114 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45107
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:55.743341 30695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:55.743742 30695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:55.743919 30695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:55.754263 30695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:55.754402 30695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:55.754565 30695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:50:55.764758 30695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:55.766079 30695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:55.767316 30695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:55.780038 30703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:55.780083 30706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:55.780117 30704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:55.781349 30695 server_base.cc:1034] running on GCE node
I20260811 06:50:55.781949 30695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:55.782850 30695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:55.784062 30695 hybrid_clock.cc:648] HybridClock initialized: now 1786431055784006 us; error 48 us; skew 500 ppm
I20260811 06:50:55.784368 30695 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:55 dist-test-slave-7lbf krb5kdc[30295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431055, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:55.787405 30695 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:50:55.788825 30695 webserver.cc:460] Webserver started at http://127.12.145.2:38373/ using document root <none> and password file <none>
I20260811 06:50:55.789490 30695 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:55.789636 30695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:55.789927 30695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:55.792791 30695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "2276db09b40e408c9ff3a60d7c5ebc63"
format_stamp: "Formatted at 2026-08-11 06:50:55 on dist-test-slave-7lbf"
server_key: "b1dd39dce852dacf3287a581e8a44d5d"
server_key_iv: "78b61b43a2d05bb8706a3a376f874492"
server_key_version: "encryptionkey@0"
I20260811 06:50:55.793584 30695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "2276db09b40e408c9ff3a60d7c5ebc63"
format_stamp: "Formatted at 2026-08-11 06:50:55 on dist-test-slave-7lbf"
server_key: "b1dd39dce852dacf3287a581e8a44d5d"
server_key_iv: "78b61b43a2d05bb8706a3a376f874492"
server_key_version: "encryptionkey@0"
I20260811 06:50:55.799226 30695 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260811 06:50:55.802572 30718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:55.803825 30695 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 06:50:55.803984 30695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "2276db09b40e408c9ff3a60d7c5ebc63"
format_stamp: "Formatted at 2026-08-11 06:50:55 on dist-test-slave-7lbf"
server_key: "b1dd39dce852dacf3287a581e8a44d5d"
server_key_iv: "78b61b43a2d05bb8706a3a376f874492"
server_key_version: "encryptionkey@0"
I20260811 06:50:55.804159 30695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:55.840107 30695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:55.844395 30695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:55.844682 30695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:55.845662 30695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:55.847056 30695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:55.847134 30695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:55.847267 30695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:55.847330 30695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:55.877621 30695 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:37391
I20260811 06:50:55.877703 30907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:37391 every 8 connection(s)
I20260811 06:50:55.878909 30695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:50:55.883571 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 30695
I20260811 06:50:55.883733 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:50:55.884177 12868 external_mini_cluster.cc:1428] Setting key 9bf713f6c278f0e518ad8fabc28e6777
Aug 11 06:50:55 dist-test-slave-7lbf krb5kdc[30295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431055, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:50:55.898375 30912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:55.881488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:56909 (local address 127.12.145.62:45107)
0811 06:50:55.882010 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:55.882017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:55.882974 (+ 957us) server_negotiation.cc:407] Connection header received
0811 06:50:55.884804 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:55.884809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:55.884890 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:55.884985 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:55.886510 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:55.887285 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:55.888867 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:55.889291 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:55.889410 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:55.892860 (+ 3450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:55.892865 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:55.892868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:55.892899 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:55.895386 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:55.896082 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:55.896087 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:55.896091 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:55.896220 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:55.896628 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:55.896632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:55.896634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:55.896899 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:55.897033 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:55.897766 (+ 733us) server_negotiation.cc:299] Negotiation successful
0811 06:50:55.897986 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":221,"threads_started":1}
I20260811 06:50:55.899296 30916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:55.882093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:45107 (local address 127.12.145.2:56909)
0811 06:50:55.882773 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:55.882853 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:55.884540 (+ 1687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:55.885237 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:55.885245 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:55.885786 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:55.886346 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:55.886364 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:55.887438 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:55.887442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:55.888662 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:55.888674 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:55.889537 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:55.889546 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:55.889768 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:55.890386 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:55.890413 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:55.892651 (+ 2238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:55.895510 (+ 2859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:55.895519 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:55.895536 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:55.895977 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:55.896326 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:55.896331 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:55.896334 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:55.896515 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:55.897018 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:55.897026 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:55.897373 (+ 347us) client_negotiation.cc:769] Sending connection context
0811 06:50:55.897648 (+ 275us) client_negotiation.cc:240] Negotiation successful
0811 06:50:55.898171 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":272,"threads_started":1}
I20260811 06:50:55.900694 30908 heartbeater.cc:347] Connected to a master server at 127.12.145.62:45107
I20260811 06:50:55.900997 30908 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:55.901762 30908 heartbeater.cc:511] Master 127.12.145.62:45107 requested a full tablet report, sending...
I20260811 06:50:55.903184 30373 ts_manager.cc:194] Registered new tserver with Master: 2276db09b40e408c9ff3a60d7c5ebc63 (127.12.145.2:37391)
I20260811 06:50:55.904261 30373 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:56909
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:50:55.943832 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45107
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:43411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:50:56.271364 30921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:50:56.271646 30921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:50:56.271750 30921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:50:56.279161 30921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:50:56.279271 30921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:50:56.279390 30921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:50:56.289023 30921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:50:56.290388 30921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:50:56.291685 30921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:50:56.304943 30934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:56.305002 30935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:50:56.305002 30938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:50:56.305833 30921 server_base.cc:1034] running on GCE node
I20260811 06:50:56.306427 30921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:50:56.307369 30921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:50:56.308570 30921 hybrid_clock.cc:648] HybridClock initialized: now 1786431056308507 us; error 52 us; skew 500 ppm
I20260811 06:50:56.308872 30921 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:50:56 dist-test-slave-7lbf krb5kdc[30295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431056, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:50:56.311817 30921 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:50:56.313148 30921 webserver.cc:460] Webserver started at http://127.12.145.3:38761/ using document root <none> and password file <none>
I20260811 06:50:56.313894 30921 fs_manager.cc:359] Metadata directory not provided
I20260811 06:50:56.314011 30921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:50:56.314304 30921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:50:56.317157 30921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "4321aba998474daba45da07b5a0e2889"
format_stamp: "Formatted at 2026-08-11 06:50:56 on dist-test-slave-7lbf"
server_key: "3e45cc9a40d5cd5407360417a4d4142f"
server_key_iv: "8d7a13297bd2dcb394178d73358e2131"
server_key_version: "encryptionkey@0"
I20260811 06:50:56.317992 30921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "4321aba998474daba45da07b5a0e2889"
format_stamp: "Formatted at 2026-08-11 06:50:56 on dist-test-slave-7lbf"
server_key: "3e45cc9a40d5cd5407360417a4d4142f"
server_key_iv: "8d7a13297bd2dcb394178d73358e2131"
server_key_version: "encryptionkey@0"
I20260811 06:50:56.322937 30921 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 06:50:56.326236 30951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:56.327517 30921 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:50:56.327667 30921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "4321aba998474daba45da07b5a0e2889"
format_stamp: "Formatted at 2026-08-11 06:50:56 on dist-test-slave-7lbf"
server_key: "3e45cc9a40d5cd5407360417a4d4142f"
server_key_iv: "8d7a13297bd2dcb394178d73358e2131"
server_key_version: "encryptionkey@0"
I20260811 06:50:56.327855 30921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:50:56.354347 30921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:50:56.358273 30921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:50:56.358573 30921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:50:56.359515 30921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:50:56.360853 30921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:50:56.360931 30921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:56.361053 30921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:50:56.361106 30921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:50:56.362388 30681 heartbeater.cc:503] Master 127.12.145.62:45107 was elected leader, sending a full tablet report...
I20260811 06:50:56.391754 30921 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:38151
I20260811 06:50:56.391800 31130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:38151 every 8 connection(s)
I20260811 06:50:56.393030 30921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:50:56.400188 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 30921
I20260811 06:50:56.400395 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:50:56.400972 12868 external_mini_cluster.cc:1428] Setting key 146fe6b06affe77e2d1c2e3d8efe3e05
Aug 11 06:50:56 dist-test-slave-7lbf krb5kdc[30295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431056, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:50:56.413244 30912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.395624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:38857 (local address 127.12.145.62:45107)
0811 06:50:56.395797 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:56.395802 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:56.397005 (+ 1203us) server_negotiation.cc:407] Connection header received
0811 06:50:56.398864 (+ 1859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:56.398870 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:56.398967 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:56.399059 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:56.400856 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.401869 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.403916 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.404324 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.404414 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.407777 (+ 3363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:56.407782 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:56.407785 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:56.407820 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:56.410442 (+ 2622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:56.411245 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:56.411248 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:56.411250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:56.411368 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:56.411757 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:56.411760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:56.411762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:56.412035 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:56.412151 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:56.412819 (+ 668us) server_negotiation.cc:299] Negotiation successful
0811 06:50:56.413003 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:50:56.414395 31135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.396128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:45107 (local address 127.12.145.3:38857)
0811 06:50:56.396844 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:56.396883 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:56.398591 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:56.399306 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:56.399315 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:56.399853 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:50:56.400661 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.400690 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.402042 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.402046 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.403759 (+ 1713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.403782 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.404533 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.404539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.404735 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.405358 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:50:56.405382 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:50:56.407594 (+ 2212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:50:56.410600 (+ 3006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:56.410608 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:56.410621 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:56.411142 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:56.411449 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:50:56.411452 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:50:56.411454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:50:56.411666 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:50:56.412142 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:50:56.412148 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:50:56.412481 (+ 333us) client_negotiation.cc:769] Sending connection context
0811 06:50:56.412743 (+ 262us) client_negotiation.cc:240] Negotiation successful
0811 06:50:56.413161 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":278,"threads_started":1}
I20260811 06:50:56.415783 31131 heartbeater.cc:347] Connected to a master server at 127.12.145.62:45107
I20260811 06:50:56.416117 31131 heartbeater.cc:464] Registering TS with master...
I20260811 06:50:56.416947 31131 heartbeater.cc:511] Master 127.12.145.62:45107 requested a full tablet report, sending...
I20260811 06:50:56.418417 30372 ts_manager.cc:194] Registered new tserver with Master: 4321aba998474daba45da07b5a0e2889 (127.12.145.3:38151)
I20260811 06:50:56.419270 30372 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:38857
I20260811 06:50:56.428918 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:50:56.445873 30912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.433546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35194 (local address 127.12.145.62:45107)
0811 06:50:56.433750 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:56.433757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:56.434202 (+ 445us) server_negotiation.cc:407] Connection header received
0811 06:50:56.434374 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:56.434378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:56.434448 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:56.434533 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:56.436052 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.436788 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.438022 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.438419 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.438519 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.440840 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:56.440846 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:56.440849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:56.440880 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:56.443395 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:56.444036 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:56.444040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:56.444042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:56.444154 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:56.444572 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:56.444574 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:56.444576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:56.444875 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:56.445069 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:56.445337 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 06:50:56.445545 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 06:50:56.450212 30372 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35194:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:50:56.457468 30372 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:50:56.491755 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.470907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41820 (local address 127.12.145.1:45353)
0811 06:50:56.482842 (+ 11935us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:56.482853 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:56.483566 (+ 713us) server_negotiation.cc:407] Connection header received
0811 06:50:56.483726 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:56.483734 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:56.483989 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:56.484206 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:56.485327 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.486904 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.489611 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.490635 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.490764 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.491017 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:56.491265 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 06:50:56.491425 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11764,"thread_start_us":11618,"threads_started":1}
I20260811 06:50:56.491875 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.470678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45353 (local address 127.0.0.1:41820)
0811 06:50:56.483419 (+ 12741us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:56.483437 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:56.483565 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:56.484517 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:56.484522 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:56.484546 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:56.485082 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.485099 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.487052 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.487057 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.489447 (+ 2390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.489459 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.490840 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.490846 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.491033 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.491084 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 06:50:56.491209 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 06:50:56.491409 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12609,"mutex_wait_us":21,"thread_start_us":12021,"threads_started":1}
I20260811 06:50:56.492537 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.470406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35714 (local address 127.12.145.3:38151)
0811 06:50:56.482477 (+ 12071us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:56.482486 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:56.483288 (+ 802us) server_negotiation.cc:407] Connection header received
0811 06:50:56.483415 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:56.483424 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:56.483706 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:56.483932 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:56.484792 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.486389 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.489271 (+ 2882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.490719 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.490841 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.491084 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:56.491982 (+ 898us) server_negotiation.cc:299] Negotiation successful
0811 06:50:56.492155 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11884,"thread_start_us":11685,"threads_started":1}
I20260811 06:50:56.493034 31159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.470182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:38151 (local address 127.0.0.1:35714)
0811 06:50:56.482453 (+ 12271us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:56.482474 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:56.482616 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:56.484022 (+ 1406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:56.484031 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:56.484063 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:56.484532 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.484549 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.486551 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.486557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.489097 (+ 2540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.489113 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.491269 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.491277 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.491463 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.491501 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 06:50:56.491606 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 06:50:56.491744 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12142,"mutex_wait_us":103,"thread_start_us":9996,"threads_started":1}
I20260811 06:50:56.493300 31153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.469991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48846 (local address 127.12.145.2:37391)
0811 06:50:56.483277 (+ 13286us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:56.483286 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:56.483705 (+ 419us) server_negotiation.cc:407] Connection header received
0811 06:50:56.483812 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:56.483819 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:56.484462 (+ 643us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:56.485335 (+ 873us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:56.485552 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.486528 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.489102 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.490671 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.490916 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.491084 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:56.492853 (+ 1769us) server_negotiation.cc:299] Negotiation successful
0811 06:50:56.493013 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13126,"thread_start_us":13021,"threads_started":1}
I20260811 06:50:56.493755 31155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.469766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:37391 (local address 127.0.0.1:48846)
0811 06:50:56.480681 (+ 10915us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:56.480750 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:56.480987 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:56.484689 (+ 3702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:56.484693 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:56.484717 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:56.485171 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.485181 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.486685 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.486692 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.488934 (+ 2242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.488949 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.491316 (+ 2367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.491324 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.492153 (+ 829us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.492189 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 06:50:56.492288 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 06:50:56.492605 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10598,"mutex_wait_us":135,"thread_start_us":13324,"threads_started":1}
I20260811 06:50:56.496318 30575 tablet_service.cc:1467] Processing CreateTablet for tablet 5792c7ded8d744eaa11befbf015d6cf1 (DEFAULT_TABLE table=test-table [id=9efefe75daee44a5842f295768b74e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:56.496773 31026 tablet_service.cc:1467] Processing CreateTablet for tablet 5792c7ded8d744eaa11befbf015d6cf1 (DEFAULT_TABLE table=test-table [id=9efefe75daee44a5842f295768b74e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:56.497733 30575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5792c7ded8d744eaa11befbf015d6cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:56.497627 30798 tablet_service.cc:1467] Processing CreateTablet for tablet 5792c7ded8d744eaa11befbf015d6cf1 (DEFAULT_TABLE table=test-table [id=9efefe75daee44a5842f295768b74e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:50:56.498307 31026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5792c7ded8d744eaa11befbf015d6cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:56.499032 30798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5792c7ded8d744eaa11befbf015d6cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:50:56.508950 31161 tablet_bootstrap.cc:492] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: Bootstrap starting.
I20260811 06:50:56.512511 31161 tablet_bootstrap.cc:654] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:56.513614 31161 log.cc:824] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:56.514714 31163 tablet_bootstrap.cc:492] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: Bootstrap starting.
I20260811 06:50:56.516312 31162 tablet_bootstrap.cc:492] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: Bootstrap starting.
I20260811 06:50:56.518601 31163 tablet_bootstrap.cc:654] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:56.519941 31163 log.cc:824] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:56.520056 31162 tablet_bootstrap.cc:654] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: Neither blocks nor log segments found. Creating new log.
I20260811 06:50:56.520424 31161 tablet_bootstrap.cc:492] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: No bootstrap required, opened a new log
I20260811 06:50:56.520802 31161 ts_tablet_manager.cc:1397] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260811 06:50:56.521279 31162 log.cc:824] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: Log is configured to *not* fsync() on all Append() calls
I20260811 06:50:56.523388 31163 tablet_bootstrap.cc:492] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: No bootstrap required, opened a new log
I20260811 06:50:56.523667 31163 ts_tablet_manager.cc:1397] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 06:50:56.524042 31162 tablet_bootstrap.cc:492] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: No bootstrap required, opened a new log
I20260811 06:50:56.524300 31162 ts_tablet_manager.cc:1397] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260811 06:50:56.531188 31161 raft_consensus.cc:348] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 } } peers { permanent_uuid: "4321aba998474daba45da07b5a0e2889" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38151 } } peers { permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 } }
I20260811 06:50:56.531811 31161 raft_consensus.cc:374] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:56.531931 31161 raft_consensus.cc:729] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa8865099e6e4d5bb42be86ccbbb8626, State: Initialized, Role: FOLLOWER
I20260811 06:50:56.532591 31161 consensus_queue.cc:260] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 } } peers { permanent_uuid: "4321aba998474daba45da07b5a0e2889" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38151 } } peers { permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 } }
I20260811 06:50:56.532495 31162 raft_consensus.cc:348] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 } } peers { permanent_uuid: "4321aba998474daba45da07b5a0e2889" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38151 } } peers { permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 } }
I20260811 06:50:56.532922 31162 raft_consensus.cc:374] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:56.533030 31162 raft_consensus.cc:729] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4321aba998474daba45da07b5a0e2889, State: Initialized, Role: FOLLOWER
I20260811 06:50:56.533833 31162 consensus_queue.cc:260] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 } } peers { permanent_uuid: "4321aba998474daba45da07b5a0e2889" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38151 } } peers { permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 } }
I20260811 06:50:56.534480 31161 ts_tablet_manager.cc:1428] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260811 06:50:56.534920 31131 heartbeater.cc:503] Master 127.12.145.62:45107 was elected leader, sending a full tablet report...
I20260811 06:50:56.535552 31162 ts_tablet_manager.cc:1428] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260811 06:50:56.535518 31163 raft_consensus.cc:348] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 } } peers { permanent_uuid: "4321aba998474daba45da07b5a0e2889" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38151 } } peers { permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 } }
I20260811 06:50:56.536002 31163 raft_consensus.cc:374] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:50:56.536120 31163 raft_consensus.cc:729] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2276db09b40e408c9ff3a60d7c5ebc63, State: Initialized, Role: FOLLOWER
I20260811 06:50:56.536787 31163 consensus_queue.cc:260] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 } } peers { permanent_uuid: "4321aba998474daba45da07b5a0e2889" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38151 } } peers { permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 } }
I20260811 06:50:56.538197 30908 heartbeater.cc:503] Master 127.12.145.62:45107 was elected leader, sending a full tablet report...
I20260811 06:50:56.539482 31163 ts_tablet_manager.cc:1428] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
W20260811 06:50:56.583480 30684 tablet.cc:2369] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:50:56.630884 30909 tablet.cc:2369] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:50:56.644702 31134 tablet.cc:2369] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:50:56.705302 31172 raft_consensus.cc:482] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:50:56.705662 31172 raft_consensus.cc:504] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 } } peers { permanent_uuid: "4321aba998474daba45da07b5a0e2889" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38151 } } peers { permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 } }
I20260811 06:50:56.707438 31172 leader_election.cc:288] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2276db09b40e408c9ff3a60d7c5ebc63 (127.12.145.2:37391), aa8865099e6e4d5bb42be86ccbbb8626 (127.12.145.1:45353)
I20260811 06:50:56.713968 31153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.707989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:39951 (local address 127.12.145.2:37391)
0811 06:50:56.708213 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:56.708219 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:56.708243 (+ 24us) server_negotiation.cc:407] Connection header received
0811 06:50:56.708528 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:56.708533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:56.708621 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:56.708732 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:56.709124 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.709944 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.711855 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.713045 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.713179 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.713242 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:56.713645 (+ 403us) server_negotiation.cc:299] Negotiation successful
0811 06:50:56.713763 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 06:50:56.714031 31135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.707785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:37391 (local address 127.12.145.3:39951)
0811 06:50:56.708159 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:56.708180 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:56.708328 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:56.708754 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:56.708758 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:56.708784 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:56.708976 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.708989 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.710064 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.710070 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.711672 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.711686 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.713193 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.713199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.713417 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.713455 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 06:50:56.713609 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 06:50:56.713749 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229}
I20260811 06:50:56.714900 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.708023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:33695 (local address 127.12.145.1:45353)
0811 06:50:56.708232 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:56.708237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:56.708871 (+ 634us) server_negotiation.cc:407] Connection header received
0811 06:50:56.709045 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:56.709050 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:56.709130 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:56.709209 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:50:56.709786 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.710827 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.712889 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.714011 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.714174 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.714246 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:56.714619 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 06:50:56.714728 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 06:50:56.714965 31176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.707886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45353 (local address 127.12.145.3:33695)
0811 06:50:56.708755 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:56.708772 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:50:56.708901 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:50:56.709235 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:50:56.709239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:50:56.709263 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:50:56.709630 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.709641 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.710985 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.710989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.712721 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:50:56.712737 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.714341 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.714348 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:50:56.714465 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.714488 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 06:50:56.714562 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 06:50:56.714659 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"thread_start_us":501,"threads_started":1}
I20260811 06:50:56.715202 30839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5792c7ded8d744eaa11befbf015d6cf1" candidate_uuid: "4321aba998474daba45da07b5a0e2889" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" is_pre_election: true
I20260811 06:50:56.715786 30839 raft_consensus.cc:2454] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4321aba998474daba45da07b5a0e2889 in term 0.
I20260811 06:50:56.716012 30610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5792c7ded8d744eaa11befbf015d6cf1" candidate_uuid: "4321aba998474daba45da07b5a0e2889" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" is_pre_election: true
I20260811 06:50:56.716462 30956 leader_election.cc:302] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2276db09b40e408c9ff3a60d7c5ebc63, 4321aba998474daba45da07b5a0e2889; no voters:
I20260811 06:50:56.716565 30610 raft_consensus.cc:2454] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4321aba998474daba45da07b5a0e2889 in term 0.
I20260811 06:50:56.716849 31172 raft_consensus.cc:2781] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:50:56.716995 31172 raft_consensus.cc:482] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:50:56.717110 31172 raft_consensus.cc:3037] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:56.719444 31172 raft_consensus.cc:504] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 } } peers { permanent_uuid: "4321aba998474daba45da07b5a0e2889" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38151 } } peers { permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 } }
I20260811 06:50:56.720042 31172 leader_election.cc:288] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [CANDIDATE]: Term 1 election: Requested vote from peers 2276db09b40e408c9ff3a60d7c5ebc63 (127.12.145.2:37391), aa8865099e6e4d5bb42be86ccbbb8626 (127.12.145.1:45353)
I20260811 06:50:56.720495 30839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5792c7ded8d744eaa11befbf015d6cf1" candidate_uuid: "4321aba998474daba45da07b5a0e2889" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2276db09b40e408c9ff3a60d7c5ebc63"
I20260811 06:50:56.720518 30610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5792c7ded8d744eaa11befbf015d6cf1" candidate_uuid: "4321aba998474daba45da07b5a0e2889" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa8865099e6e4d5bb42be86ccbbb8626"
I20260811 06:50:56.720688 30839 raft_consensus.cc:3037] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:56.720696 30610 raft_consensus.cc:3037] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:50:56.722949 30610 raft_consensus.cc:2454] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4321aba998474daba45da07b5a0e2889 in term 1.
I20260811 06:50:56.722965 30839 raft_consensus.cc:2454] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4321aba998474daba45da07b5a0e2889 in term 1.
I20260811 06:50:56.723309 30956 leader_election.cc:302] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2276db09b40e408c9ff3a60d7c5ebc63, 4321aba998474daba45da07b5a0e2889; no voters:
I20260811 06:50:56.723583 31172 raft_consensus.cc:2781] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:50:56.724033 31172 raft_consensus.cc:686] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 1 LEADER]: Becoming Leader. State: Replica: 4321aba998474daba45da07b5a0e2889, State: Running, Role: LEADER
I20260811 06:50:56.724560 31172 consensus_queue.cc:237] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 } } peers { permanent_uuid: "4321aba998474daba45da07b5a0e2889" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38151 } } peers { permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 } }
I20260811 06:50:56.729499 30373 catalog_manager.cc:5495] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4321aba998474daba45da07b5a0e2889 (127.12.145.3). New cstate: current_term: 1 leader_uuid: "4321aba998474daba45da07b5a0e2889" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4321aba998474daba45da07b5a0e2889" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 } health_report { overall_health: UNKNOWN } } }
I20260811 06:50:56.797132 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.792085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35724 (local address 127.12.145.3:38151)
0811 06:50:56.792264 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:56.792268 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:56.792287 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:50:56.792409 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:56.792413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:56.792498 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:56.792622 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:50:56.792961 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.793744 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.795079 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.795521 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.795617 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.796075 (+ 458us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:50:56.796603 (+ 528us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:50:56.796717 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:56.796792 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 06:50:56.796861 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 06:50:56.805063 30839 raft_consensus.cc:1261] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63 [term 1 FOLLOWER]: Refusing update from remote peer 4321aba998474daba45da07b5a0e2889: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:56.805063 30610 raft_consensus.cc:1261] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626 [term 1 FOLLOWER]: Refusing update from remote peer 4321aba998474daba45da07b5a0e2889: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:50:56.806125 31172 consensus_queue.cc:1035] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa8865099e6e4d5bb42be86ccbbb8626" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 45353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:56.806447 31177 consensus_queue.cc:1035] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2276db09b40e408c9ff3a60d7c5ebc63" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:50:56.817723 31184 mvcc.cc:205] Tried to move back new op lower bound from 7317221608663719936 to 7317221608347967488. Current Snapshot: MvccSnapshot[applied={T|T < 7317221608663719936}]
I20260811 06:50:56.820207 31183 mvcc.cc:205] Tried to move back new op lower bound from 7317221608663719936 to 7317221608347967488. Current Snapshot: MvccSnapshot[applied={T|T < 7317221608663719936}]
I20260811 06:50:56.829538 30373 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:50:56.829833 30373 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:50:56.833627 30373 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f3b5d0f8905043dd92c690284f14e985: Sending DeleteTablet for 3 replicas of tablet 5792c7ded8d744eaa11befbf015d6cf1
I20260811 06:50:56.834933 30575 tablet_service.cc:1514] Processing DeleteTablet for tablet 5792c7ded8d744eaa11befbf015d6cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:56 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:41820
I20260811 06:50:56.835142 31026 tablet_service.cc:1514] Processing DeleteTablet for tablet 5792c7ded8d744eaa11befbf015d6cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:56 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:35714
I20260811 06:50:56.835788 30798 tablet_service.cc:1514] Processing DeleteTablet for tablet 5792c7ded8d744eaa11befbf015d6cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:50:56 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:48846
I20260811 06:50:56.836954 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 30468
I20260811 06:50:56.847476 31197 tablet_replica.cc:330] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: stopping tablet replica
I20260811 06:50:56.847958 31197 raft_consensus.cc:2229] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:50:56.848538 31197 raft_consensus.cc:2258] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:56.849364 31201 tablet_replica.cc:330] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: stopping tablet replica
I20260811 06:50:56.849915 31201 raft_consensus.cc:2229] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:50:56.850420 31201 raft_consensus.cc:2258] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:56.851194 31199 tablet_replica.cc:330] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: stopping tablet replica
I20260811 06:50:56.851698 31199 raft_consensus.cc:2229] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:50:56.852492 31199 raft_consensus.cc:2258] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:50:56.852695 31201 ts_tablet_manager.cc:1905] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:56.855077 31199 ts_tablet_manager.cc:1905] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 06:50:56 dist-test-slave-7lbf krb5kdc[30295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:50:56.860206 31201 ts_tablet_manager.cc:1918] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:50:56.862140 31197 ts_tablet_manager.cc:1905] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:50:56.863332 31199 ts_tablet_manager.cc:1918] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:50:56.863598 31199 log.cc:1196] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/5792c7ded8d744eaa11befbf015d6cf1
I20260811 06:50:56.864329 31199 ts_tablet_manager.cc:1939] T 5792c7ded8d744eaa11befbf015d6cf1 P 4321aba998474daba45da07b5a0e2889: Deleting consensus metadata
I20260811 06:50:56.866480 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:56.838806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41834 (local address 127.12.145.1:45353)
0811 06:50:56.838993 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:56.839001 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:56.846023 (+ 7022us) server_negotiation.cc:407] Connection header received
0811 06:50:56.846221 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:56.846229 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:56.846368 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:56.846482 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:56.848419 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.849610 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.851484 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:56.852098 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:56.852205 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:56.857857 (+ 5652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:56.857874 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:56.857891 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:56.857943 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:56.862470 (+ 4527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:56.863384 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:56.863394 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:56.863398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:56.863598 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:56.864163 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:56.864169 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:56.864173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:56.864697 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:56.865034 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:56.865749 (+ 715us) server_negotiation.cc:299] Negotiation successful
0811 06:50:56.866019 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 06:50:56.866453 30348 catalog_manager.cc:4841] TS 4321aba998474daba45da07b5a0e2889 (127.12.145.3:38151): tablet 5792c7ded8d744eaa11befbf015d6cf1 (table test-table [id=9efefe75daee44a5842f295768b74e15]) successfully deleted
I20260811 06:50:56.868062 30672 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:56.869196 31201 log.cc:1196] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/5792c7ded8d744eaa11befbf015d6cf1
I20260811 06:50:56.869894 31201 ts_tablet_manager.cc:1939] T 5792c7ded8d744eaa11befbf015d6cf1 P 2276db09b40e408c9ff3a60d7c5ebc63: Deleting consensus metadata
I20260811 06:50:56.872010 30349 catalog_manager.cc:4841] TS 2276db09b40e408c9ff3a60d7c5ebc63 (127.12.145.2:37391): tablet 5792c7ded8d744eaa11befbf015d6cf1 (table test-table [id=9efefe75daee44a5842f295768b74e15]) successfully deleted
I20260811 06:50:57.014845 31197 ts_tablet_manager.cc:1918] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:50:57.015141 31197 log.cc:1196] T 5792c7ded8d744eaa11befbf015d6cf1 P aa8865099e6e4d5bb42be86ccbbb8626: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/5792c7ded8d744eaa11befbf015d6cf1
I20260811 06:50:57.015432 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 30468
W20260811 06:50:57.047789 30352 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.1:45353 (error 108)
I20260811 06:50:57.048275 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 30695
I20260811 06:50:57.049963 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:57.049094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45353 (local address 127.0.0.1:41838)
0811 06:50:57.049571 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:57.049707 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":233,"threads_started":1}
W20260811 06:50:57.050278 30352 catalog_manager.cc:4584] TS aa8865099e6e4d5bb42be86ccbbb8626 (127.12.145.1:45353): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5792c7ded8d744eaa11befbf015d6cf1: Network error: Client connection negotiation failed: client connection to 127.12.145.1:45353: connect: Connection refused (error 111)
Aug 11 06:50:57 dist-test-slave-7lbf krb5kdc[30295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:50:57.064867 31153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:57.049162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48850 (local address 127.12.145.2:37391)
0811 06:50:57.049661 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:57.049668 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:57.049689 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:50:57.049760 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:57.049765 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:57.049862 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:57.049977 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:57.051748 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:57.052455 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:57.054345 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:57.054969 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:57.055100 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:57.059286 (+ 4186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:57.059303 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:57.059318 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:57.059352 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:57.062118 (+ 2766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:57.062783 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:57.062823 (+ 40us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:57.062825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:57.062970 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:57.063341 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:57.063345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:57.063346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:57.063716 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:57.064012 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:57.064306 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 06:50:57.064519 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373}
I20260811 06:50:57.065613 30898 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:57.104092 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:57.103510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45353 (local address 127.0.0.1:41844)
0811 06:50:57.103770 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:57.103899 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 06:50:57.105423 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:57.104961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45353 (local address 127.0.0.1:41854)
0811 06:50:57.105127 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:57.105223 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 06:50:57.154947 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 30695
I20260811 06:50:57.165953 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:57.165437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45353 (local address 127.0.0.1:41860)
0811 06:50:57.165708 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:57.165791 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
I20260811 06:50:57.167419 31209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:57.166690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45353 (local address 127.0.0.1:41866)
0811 06:50:57.167152 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:57.167262 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":246,"threads_started":1}
I20260811 06:50:57.189591 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 30921
Aug 11 06:50:57 dist-test-slave-7lbf krb5kdc[30295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:50:57.205938 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:57.190491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35730 (local address 127.12.145.3:38151)
0811 06:50:57.190721 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 06:50:57.190726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:50:57.190746 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:50:57.190815 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:50:57.190819 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:50:57.190933 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:50:57.191025 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:50:57.192293 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:57.193113 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:57.194490 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:50:57.195042 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:50:57.195167 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:50:57.199791 (+ 4624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:50:57.199806 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:50:57.199826 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:50:57.199878 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:50:57.202954 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:57.203787 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:57.203794 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:57.203796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:57.203968 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:50:57.204388 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:50:57.204391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:50:57.204393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:50:57.204759 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:50:57.204997 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 06:50:57.205357 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 06:50:57.205573 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 06:50:57.206761 31125 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:57.248131 31209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:57.247643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45353 (local address 127.0.0.1:41874)
0811 06:50:57.247870 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:57.247970 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 06:50:57.249279 31209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:57.248808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45353 (local address 127.0.0.1:41878)
0811 06:50:57.249061 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:57.249134 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260811 06:50:57.329844 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 30921
I20260811 06:50:57.357952 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 30314
I20260811 06:50:57.359069 30426 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:50:57.467104 31209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:50:57.466519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:45353 (local address 127.0.0.1:41888)
0811 06:50:57.466850 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 06:50:57.466940 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:45353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191}
I20260811 06:50:57.467191 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 30314
2026-08-11T06:50:57Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4694 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:50:57 dist-test-slave-7lbf krb5kdc[31217](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:50:57 dist-test-slave-7lbf krb5kdc[31217](info): set up 2 sockets
Aug 11 06:50:57 dist-test-slave-7lbf krb5kdc[31217](info): commencing operation
krb5kdc: starting...
W20260811 06:50:58.710379 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.003s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:50:58 dist-test-slave-7lbf krb5kdc[31217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:50:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:50:58Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.145.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.145.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/rangeradmin_127.12.145.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/rangeradmin_127.12.145.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.145.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.145.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/rangerlookup_127.12.145.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/rangerlookup_127.12.145.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.145.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.145.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/HTTP_127.12.145.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/HTTP_127.12.145.20@KRBTEST.COM.keytab.
I20260811 06:50:59.112113 12868 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskuXC_ag/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/postgres -l logfile start
2026-08-11 06:51:01.633 UTC [31261] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 06:51:01.633 UTC [31261] LOG: listening on IPv4 address "127.12.145.20", port 54883
2026-08-11 06:51:01.637 UTC [31261] LOG: listening on Unix socket "/tmp/.s.PGSQL.54883"
2026-08-11 06:51:01.659 UTC [31263] LOG: database system was shut down at 2026-08-11 06:51:00 UTC
2026-08-11 06:51:01.662 UTC [31261] LOG: database system is ready to accept connections
I20260811 06:51:02.816391 12868 mini_postgres.cc:96] Postgres bound to 54883
2026-08-11 06:51:02.841 UTC [31285] FATAL: database "slave" does not exist
127.12.145.20:54883 - accepting connections
I20260811 06:51:02.842624 12868 mini_ranger.cc:161] Starting Ranger...
I20260811 06:51:02.875809 12868 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 06:51:03.340698 12868 mini_ranger.cc:87] Created ranger Postgres database
I20260811 06:51:03.340884 12868 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-admin
2026-08-11 06:51:03,708 [I] DB FLAVOR :POSTGRES
2026-08-11 06:51:03,708 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 06:51:03,708 [I] Checking connection..
2026-08-11 06:51:03,708 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 06:51:03,976 [I] Checking connection passed.
2026-08-11 06:51:03,977 [I] --------- Verifying version history table ---------
2026-08-11 06:51:03,977 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 06:51:04,253 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 06:51:04,253 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 06:51:04,497 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 06:51:04,497 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 06:51:04,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 06:51:04.764 UTC [31401] WARNING: there is no transaction in progress
2026-08-11 06:51:04,773 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 06:51:04,773 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 06:51:05,026 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 06:51:05,026 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 06:51:05,027 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 06:51:05,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 06:51:05,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7lbf.c.gcp-upstream.internal','N') ;"
2026-08-11 06:51:05,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 06:51:06,035 [I] Table x_portal_user does not exist in database ranger
2026-08-11 06:51:06,035 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 06:51:06,311 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 06:51:06,312 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 06:51:06,549 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 06:51:06,811 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 06:51:06,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 06:51:07.798 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:07.817 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:07.839 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:07.863 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:07.884 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:07.904 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:07.972 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:07.978 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:07.992 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:08.001 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:08.011 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:08.024 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:08.033 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:08.039 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:08.045 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:08.051 UTC [31594] WARNING: there is no transaction in progress
2026-08-11 06:51:08,802 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 06:51:08,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 06:51:09,051 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 06:51:09,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 06:51:09,290 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 06:51:09,290 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 06:51:09,560 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 06:51:09,560 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 06:51:09,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 06:51:10,058 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7lbf.c.gcp-upstream.internal';"
2026-08-11 06:51:10,310 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 06:51:10,311 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 06:51:10,560 [I] DB_PATCHES have already been applied
I20260811 06:51:10.566747 12868 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-admin:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskuXC_ag/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 06:51:10.566874 12868 mini_ranger.cc:193] Using host: 127.12.145.20
I20260811 06:51:10.587747 12868 mini_ranger.cc:227] Ranger admin URL: http://127.12.145.20:55021
Aug 11, 2026 6:51:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:51:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:51:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 6:51:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 6:51:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 6:51:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 6:51:11 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 06:51:11.874909 12868 mini_ranger.cc:160] Time spent starting Ranger: real 9.032s user 0.000s sys 0.064s
Aug 11, 2026 6:51:31 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 6:51:31 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 6:51:31 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 6:51:31 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 6:51:32 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 06:51:32.986379 12868 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.145.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.145.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/rangerkms_127.12.145.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/rangerkms_127.12.145.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.145.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.145.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.145.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/HTTP_127.12.145.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.145.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/HTTP_127.12.145.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 06:51:33 dist-test-slave-7lbf krb5kdc[31217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431093, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 06:51:33.192198 12868 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 06:51:33.220422 12868 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 06:51:34.037597 12868 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 06:51:34.037730 12868 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-kms
I20260811 06:51:34.037885 12868 mini_ranger_kms.cc:227] Using postgres at 127.12.145.20:54883
2026-08-11 06:51:34,518 [I] DB FLAVOR :POSTGRES
2026-08-11 06:51:34,518 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 06:51:34,518 [I] Checking connection
2026-08-11 06:51:34,518 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 06:51:34,807 [I] connection success
2026-08-11 06:51:34,807 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 06:51:34,807 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 06:51:34,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 06:51:35,076 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 06:51:35,076 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 06:51:35,076 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 06:51:35,077 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:54883/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 06:51:35,368 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 06:51:35.877274 12868 mini_ranger_kms.cc:310] Created kms service
I20260811 06:51:36.090667 12868 mini_ranger_kms.cc:326] Created kudu user
I20260811 06:51:36.133201 12868 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 06:51:36 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431093, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:51:36.528741 12868 mini_ranger_kms.cc:384] Added ranger policy
I20260811 06:51:36.530545 12868 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-kms:/tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 06:51:36.530623 12868 mini_ranger_kms.cc:240] Using host: 127.12.145.20
I20260811 06:51:36.560458 12868 mini_ranger_kms.cc:276] Ranger KMS PID: 31885
I20260811 06:51:36.560645 12868 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.145.20:51129
Aug 11, 2026 6:51:37 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:51:37 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:51:37 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 6:51:37 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 6:51:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 6:51:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 06:51:38 dist-test-slave-7lbf krb5kdc[31217](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786431098, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:51:39.194852 12868 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.003s user 0.112s sys 0.412s
I20260811 06:51:39.195237 12868 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 06:51:39.195472 12868 mini_ranger_kms.cc:401] 127.12.145.20:51129/kms/v1/keys
Aug 11 06:51:39 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431098, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.20@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
Aug 11 06:51:39 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431098, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.20@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
Aug 11 06:51:42 dist-test-slave-7lbf krb5kdc[31217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:51:42.181034 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:33001
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:33001
--ranger_config_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:51129/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:51:42.548321 31984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:51:42.548623 31984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:51:42.548769 31984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:51:42.556689 31984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:51:42.556823 31984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:51:42.556910 31984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:51:42.556994 31984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:51:42.557063 31984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:51:42.568105 31984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.145.20:51129/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:33001
--ranger_config_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:33001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:51:42.569450 31984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:51:42.570803 31984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:51:42.583118 31992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:51:42.583568 31995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:51:42.583985 31997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:51:42.584542 31984 server_base.cc:1034] running on GCE node
I20260811 06:51:42.585301 31984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:51:42.586743 31984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:51:42.587955 31984 hybrid_clock.cc:648] HybridClock initialized: now 1786431102587904 us; error 40 us; skew 500 ppm
I20260811 06:51:42.588307 31984 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:51:42 dist-test-slave-7lbf krb5kdc[31217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431102, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:51:42.595808 31984 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:51:42.597491 31984 webserver.cc:460] Webserver started at http://127.12.145.62:39983/ using document root <none> and password file <none>
I20260811 06:51:42.598214 31984 fs_manager.cc:359] Metadata directory not provided
I20260811 06:51:42.598332 31984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:51:42.598639 31984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 06:51:42 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431102, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:51:42.660069 31984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "ba558b0310db4993834385c0c6e9c930"
format_stamp: "Formatted at 2026-08-11 06:51:42 on dist-test-slave-7lbf"
server_key: "82430471307dda799c8bc8d52d76f66b"
server_key_iv: "a2d1c23de0b000c0cc2dfccf381ef742"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:42.661548 31984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "ba558b0310db4993834385c0c6e9c930"
format_stamp: "Formatted at 2026-08-11 06:51:42 on dist-test-slave-7lbf"
server_key: "82430471307dda799c8bc8d52d76f66b"
server_key_iv: "a2d1c23de0b000c0cc2dfccf381ef742"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:42.669793 31984 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.001s
I20260811 06:51:42.688414 32011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:51:42.690014 31984 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 06:51:42.690219 31984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "ba558b0310db4993834385c0c6e9c930"
format_stamp: "Formatted at 2026-08-11 06:51:42 on dist-test-slave-7lbf"
server_key: "82430471307dda799c8bc8d52d76f66b"
server_key_iv: "a2d1c23de0b000c0cc2dfccf381ef742"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:42.690471 31984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:51:42.708002 31984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:51:42.712460 31984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:51:42.712889 31984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:51:42.735612 31984 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:33001
I20260811 06:51:42.735767 32092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:33001 every 8 connection(s)
I20260811 06:51:42.737011 31984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:51:42.741250 32093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:51:42.744258 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 31984
I20260811 06:51:42.744472 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:51:42.745200 12868 external_mini_cluster.cc:1428] Setting key a8692e5b1a57f053b6a1e2ff075cdc41
I20260811 06:51:42.756880 32093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930: Bootstrap starting.
I20260811 06:51:42.760903 32093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930: Neither blocks nor log segments found. Creating new log.
I20260811 06:51:42.762426 32093 log.cc:824] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930: Log is configured to *not* fsync() on all Append() calls
I20260811 06:51:42.765628 32093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930: No bootstrap required, opened a new log
Aug 11 06:51:42 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:51:42.773957 32093 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba558b0310db4993834385c0c6e9c930" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33001 } }
I20260811 06:51:42.774356 32093 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:51:42.774459 32093 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba558b0310db4993834385c0c6e9c930, State: Initialized, Role: FOLLOWER
I20260811 06:51:42.774895 32099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:42.747290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52768 (local address 127.12.145.62:33001)
0811 06:51:42.752146 (+ 4856us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:42.752161 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:42.752501 (+ 340us) server_negotiation.cc:407] Connection header received
0811 06:51:42.755378 (+ 2877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:42.755412 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:42.755934 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:42.756312 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:51:42.758242 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:42.760868 (+ 2626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:42.762308 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:42.763383 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:42.763583 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:42.767395 (+ 3812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:51:42.767404 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:51:42.767423 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:51:42.767467 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:51:42.770716 (+ 3249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:42.771404 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:42.771411 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:42.771419 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:42.771574 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:42.771970 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:42.771974 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:42.771976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:42.772550 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:51:42.772880 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:42.773322 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 06:51:42.773751 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4586,"thread_start_us":4305,"threads_started":1}
I20260811 06:51:42.775099 32093 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba558b0310db4993834385c0c6e9c930" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33001 } }
I20260811 06:51:42.775421 32093 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:51:42.775586 32093 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:51:42.775789 32093 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:51:42.778825 32093 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba558b0310db4993834385c0c6e9c930" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33001 } }
I20260811 06:51:42.779285 32093 leader_election.cc:302] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba558b0310db4993834385c0c6e9c930; no voters:
I20260811 06:51:42.779873 32093 leader_election.cc:288] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:51:42.780001 32101 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:51:42.780800 32101 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [term 1 LEADER]: Becoming Leader. State: Replica: ba558b0310db4993834385c0c6e9c930, State: Running, Role: LEADER
I20260811 06:51:42.781345 32101 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba558b0310db4993834385c0c6e9c930" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33001 } }
I20260811 06:51:42.782107 32093 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:51:42.784312 32107 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba558b0310db4993834385c0c6e9c930. Latest consensus state: current_term: 1 leader_uuid: "ba558b0310db4993834385c0c6e9c930" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba558b0310db4993834385c0c6e9c930" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33001 } } }
I20260811 06:51:42.784770 32107 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [sys.catalog]: This master's current role is: LEADER
I20260811 06:51:42.788836 32093 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 06:51:42.797673 32103 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba558b0310db4993834385c0c6e9c930" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba558b0310db4993834385c0c6e9c930" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 33001 } } }
I20260811 06:51:42.798768 32103 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930 [sys.catalog]: This master's current role is: LEADER
I20260811 06:51:42.800442 32115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:51:42.806699 32115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:51:42.817914 32115 catalog_manager.cc:1347] Generated new cluster ID: fe54f612f1554d9cad09c4880b13ed4f
I20260811 06:51:42.818049 32115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:51:42.836251 32115 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:51:42.837811 32115 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:51:42.844775 32115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930: Generated new TSK 0
I20260811 06:51:42.845716 32115 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:51:43.651611 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:51129/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33001
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:51:43 dist-test-slave-7lbf krb5kdc[31217](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786431103, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 06:51:44.110008 32173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:51:44.110569 32173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:51:44.110790 32173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:51:44.122478 32173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:51:44.122641 32173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:51:44.122897 32173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:51:44.138986 32173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.145.20:51129/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33001
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:51:44.141044 32173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:51:44.143424 32173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:51:44.161312 32197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:51:44.161441 32201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:51:44.165582 32173 server_base.cc:1034] running on GCE node
W20260811 06:51:44.166393 32206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:51:44.167279 32173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:51:44.168605 32173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:51:44.169889 32173 hybrid_clock.cc:648] HybridClock initialized: now 1786431104169816 us; error 58 us; skew 500 ppm
I20260811 06:51:44.170320 32173 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:51:44 dist-test-slave-7lbf krb5kdc[31217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:51:44.174912 32173 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:51:44.177320 32173 webserver.cc:460] Webserver started at http://127.12.145.1:38063/ using document root <none> and password file <none>
I20260811 06:51:44.178584 32173 fs_manager.cc:359] Metadata directory not provided
I20260811 06:51:44.178757 32173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:51:44.179263 32173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 06:51:44 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:51:44.203583 32173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "07aaff0282b0486fa2e80feb8bd8625d"
format_stamp: "Formatted at 2026-08-11 06:51:44 on dist-test-slave-7lbf"
server_key: "ab1993bc5c5c06a379478df5dd0d1597"
server_key_iv: "6630f76cba1e078cc1105cbeba9397fb"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:44.207969 32173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "07aaff0282b0486fa2e80feb8bd8625d"
format_stamp: "Formatted at 2026-08-11 06:51:44 on dist-test-slave-7lbf"
server_key: "ab1993bc5c5c06a379478df5dd0d1597"
server_key_iv: "6630f76cba1e078cc1105cbeba9397fb"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:44.225077 32173 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.006s sys 0.007s
I20260811 06:51:44.248777 32216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:51:44.250489 32173 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.006s sys 0.000s
I20260811 06:51:44.250703 32173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "07aaff0282b0486fa2e80feb8bd8625d"
format_stamp: "Formatted at 2026-08-11 06:51:44 on dist-test-slave-7lbf"
server_key: "ab1993bc5c5c06a379478df5dd0d1597"
server_key_iv: "6630f76cba1e078cc1105cbeba9397fb"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:44.250948 32173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:51:44.286381 32173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:51:44.292382 32173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:51:44.292837 32173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:51:44.299322 32173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:51:44.309551 32173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:51:44.309765 32173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260811 06:51:44.309942 32173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:51:44.310019 32173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:51:44.387076 32173 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:34699
I20260811 06:51:44.387195 32389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:34699 every 8 connection(s)
I20260811 06:51:44.388867 32173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:51:44.398765 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 32173
I20260811 06:51:44.398990 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:51:44.399812 12868 external_mini_cluster.cc:1428] Setting key 8133b99676762c89536da7dff7273fbd
Aug 11 06:51:44 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
I20260811 06:51:44.451448 32394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:44.405878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:53545 (local address 127.12.145.62:33001)
0811 06:51:44.427318 (+ 21440us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:44.427325 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:44.428946 (+ 1621us) server_negotiation.cc:407] Connection header received
0811 06:51:44.431612 (+ 2666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:44.431620 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:44.431736 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:44.431886 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:51:44.434390 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:44.435711 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:44.438389 (+ 2678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:44.439140 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:44.439242 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:44.444148 (+ 4906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:51:44.444155 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:51:44.444160 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:51:44.444203 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:51:44.447623 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:44.448585 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:44.448591 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:44.448595 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:44.448748 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:44.449290 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:44.449295 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:44.449298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:44.449685 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:51:44.449811 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:44.450869 (+ 1058us) server_negotiation.cc:299] Negotiation successful
0811 06:51:44.451102 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21280,"thread_start_us":21442,"threads_started":1}
I20260811 06:51:44.453747 32392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:44.404577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:33001 (local address 127.12.145.1:53545)
0811 06:51:44.428306 (+ 23729us) negotiation.cc:107] Waiting for socket to connect
0811 06:51:44.428389 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0811 06:51:44.431221 (+ 2832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:51:44.432405 (+ 1184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:51:44.432419 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:51:44.433099 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:51:44.434124 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:44.434163 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:44.435964 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:44.435970 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:44.438200 (+ 2230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:44.438217 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:44.439658 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:44.439666 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:44.439986 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:44.440850 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:51:44.440882 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:51:44.443838 (+ 2956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:51:44.447804 (+ 3966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:51:44.447814 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:51:44.447866 (+ 52us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:51:44.448442 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:51:44.448911 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:51:44.448914 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:51:44.448917 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:51:44.449165 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:51:44.449912 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:51:44.449920 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:51:44.450381 (+ 461us) client_negotiation.cc:769] Sending connection context
0811 06:51:44.451670 (+ 1289us) client_negotiation.cc:240] Negotiation successful
0811 06:51:44.452241 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23353,"thread_start_us":23089,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
I20260811 06:51:44.455859 32390 heartbeater.cc:347] Connected to a master server at 127.12.145.62:33001
I20260811 06:51:44.456177 32390 heartbeater.cc:464] Registering TS with master...
I20260811 06:51:44.457049 32390 heartbeater.cc:511] Master 127.12.145.62:33001 requested a full tablet report, sending...
I20260811 06:51:44.463071 32034 ts_manager.cc:194] Registered new tserver with Master: 07aaff0282b0486fa2e80feb8bd8625d (127.12.145.1:34699)
I20260811 06:51:44.465234 32034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:53545
Aug 11 06:51:44 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431103, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
W20260811 06:51:44.507781 12868 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.12.145.2: real 0.104s user 0.000s sys 0.024s
I20260811 06:51:44.508661 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:51129/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33001
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:51:44 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431103, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
W20260811 06:51:45.000859 32398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:51:45.001467 32398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:51:45.001745 32398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:51:45.013401 32398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:51:45.013659 32398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:51:45.013898 32398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:51:45.029309 32398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.145.20:51129/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33001
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:51:45.031242 32398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:51:45.033058 32398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:51:45.064793 32408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:51:45.065929 32410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:51:45.066111 32406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:51:45.068079 32398 server_base.cc:1034] running on GCE node
I20260811 06:51:45.068946 32398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:51:45.070312 32398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:51:45.071534 32398 hybrid_clock.cc:648] HybridClock initialized: now 1786431105071426 us; error 100 us; skew 500 ppm
I20260811 06:51:45.071966 32398 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:51:45 dist-test-slave-7lbf krb5kdc[31217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431105, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:51:45.075306 32398 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:51:45.077026 32398 webserver.cc:460] Webserver started at http://127.12.145.2:44721/ using document root <none> and password file <none>
I20260811 06:51:45.077803 32398 fs_manager.cc:359] Metadata directory not provided
I20260811 06:51:45.077929 32398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:51:45.078269 32398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 06:51:45 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431105, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:51:45.097920 32398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "58169d5b5cd74cc9be5c249afeb3a8d3"
format_stamp: "Formatted at 2026-08-11 06:51:45 on dist-test-slave-7lbf"
server_key: "7069be925795d7c2a57108f0d80a2043"
server_key_iv: "d955e330912b3797ec10a7d2f991f46e"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:45.099084 32398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "58169d5b5cd74cc9be5c249afeb3a8d3"
format_stamp: "Formatted at 2026-08-11 06:51:45 on dist-test-slave-7lbf"
server_key: "7069be925795d7c2a57108f0d80a2043"
server_key_iv: "d955e330912b3797ec10a7d2f991f46e"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:45.106211 32398 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260811 06:51:45.124547 32445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:51:45.126176 32398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:51:45.126350 32398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "58169d5b5cd74cc9be5c249afeb3a8d3"
format_stamp: "Formatted at 2026-08-11 06:51:45 on dist-test-slave-7lbf"
server_key: "7069be925795d7c2a57108f0d80a2043"
server_key_iv: "d955e330912b3797ec10a7d2f991f46e"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:45.126587 32398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:51:45.146013 32398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:51:45.150285 32398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:51:45.150609 32398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:51:45.151640 32398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:51:45.153213 32398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:51:45.153293 32398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:51:45.153426 32398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:51:45.153479 32398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:51:45.194326 32398 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:43575
I20260811 06:51:45.194289 32648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:43575 every 8 connection(s)
I20260811 06:51:45.195981 32398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:51:45.205785 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 32398
I20260811 06:51:45.205972 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:51:45.206504 12868 external_mini_cluster.cc:1428] Setting key 5a4394b87dbffde88f5b22daf2200a69
Aug 11 06:51:45 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431105, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:51:45.220517 32652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.198834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:54659 (local address 127.12.145.62:33001)
0811 06:51:45.199333 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:45.199340 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:45.200425 (+ 1085us) server_negotiation.cc:407] Connection header received
0811 06:51:45.202952 (+ 2527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:45.202956 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:45.203026 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:45.203119 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:51:45.204998 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.205789 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.207702 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.208309 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.208444 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.212880 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:51:45.212886 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:51:45.212891 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:51:45.212932 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:51:45.216390 (+ 3458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:45.217427 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:45.217433 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:45.217437 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:45.217615 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:45.218171 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:45.218176 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:45.218178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:45.218542 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:51:45.218679 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:45.219609 (+ 930us) server_negotiation.cc:299] Negotiation successful
0811 06:51:45.220145 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":359,"thread_start_us":226,"threads_started":1}
I20260811 06:51:45.221627 32654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.199435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:33001 (local address 127.12.145.2:54659)
0811 06:51:45.200242 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0811 06:51:45.200301 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 06:51:45.202655 (+ 2354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:51:45.203386 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:51:45.203397 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:51:45.203998 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:51:45.204817 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:45.204843 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.205960 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.205965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:45.207555 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:45.207568 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.208586 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.208594 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:45.208815 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.209656 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:51:45.209687 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:51:45.212590 (+ 2903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:51:45.216565 (+ 3975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:51:45.216576 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:51:45.216595 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:51:45.217289 (+ 694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:51:45.217738 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:51:45.217743 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:51:45.217747 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:51:45.218051 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:51:45.218700 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:51:45.218708 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:51:45.219176 (+ 468us) client_negotiation.cc:769] Sending connection context
0811 06:51:45.219498 (+ 322us) client_negotiation.cc:240] Negotiation successful
0811 06:51:45.220084 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":322,"threads_started":1}
I20260811 06:51:45.223186 32649 heartbeater.cc:347] Connected to a master server at 127.12.145.62:33001
I20260811 06:51:45.223555 32649 heartbeater.cc:464] Registering TS with master...
I20260811 06:51:45.224661 32649 heartbeater.cc:511] Master 127.12.145.62:33001 requested a full tablet report, sending...
I20260811 06:51:45.226590 32034 ts_manager.cc:194] Registered new tserver with Master: 58169d5b5cd74cc9be5c249afeb3a8d3 (127.12.145.2:43575)
I20260811 06:51:45.227674 32034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:54659
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:51:45.271219 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:51129/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33001
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:51:45.470009 32390 heartbeater.cc:503] Master 127.12.145.62:33001 was elected leader, sending a full tablet report...
W20260811 06:51:45.643270 32658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:51:45.643656 32658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:51:45.643859 32658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:51:45.651465 32658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:51:45.651575 32658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:51:45.651733 32658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:51:45.662103 32658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.145.20:51129/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:33001
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:51:45.663451 32658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:51:45.664726 32658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:51:45.677863 32665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:51:45.677830 32671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:51:45.677896 32666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:51:45.678963 32658 server_base.cc:1034] running on GCE node
I20260811 06:51:45.679543 32658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:51:45.680464 32658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:51:45.681648 32658 hybrid_clock.cc:648] HybridClock initialized: now 1786431105681585 us; error 53 us; skew 500 ppm
I20260811 06:51:45.681955 32658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:51:45 dist-test-slave-7lbf krb5kdc[31217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431105, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:51:45.684988 32658 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:51:45.687752 32658 webserver.cc:460] Webserver started at http://127.12.145.3:33333/ using document root <none> and password file <none>
I20260811 06:51:45.688433 32658 fs_manager.cc:359] Metadata directory not provided
I20260811 06:51:45.688556 32658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:51:45.688892 32658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 06:51:45 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431105, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:51:45.706653 32658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "a92ab79813d841fd961e6199607e68a5"
format_stamp: "Formatted at 2026-08-11 06:51:45 on dist-test-slave-7lbf"
server_key: "c99f8d5de624c1edb9f4857b42b5f7a4"
server_key_iv: "8ccd58a78b73f2bd1f5d16f8e1352492"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:45.707940 32658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "a92ab79813d841fd961e6199607e68a5"
format_stamp: "Formatted at 2026-08-11 06:51:45 on dist-test-slave-7lbf"
server_key: "c99f8d5de624c1edb9f4857b42b5f7a4"
server_key_iv: "8ccd58a78b73f2bd1f5d16f8e1352492"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:45.715860 32658 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260811 06:51:45.732772 32685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:51:45.734355 32658 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:51:45.734555 32658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "a92ab79813d841fd961e6199607e68a5"
format_stamp: "Formatted at 2026-08-11 06:51:45 on dist-test-slave-7lbf"
server_key: "c99f8d5de624c1edb9f4857b42b5f7a4"
server_key_iv: "8ccd58a78b73f2bd1f5d16f8e1352492"
server_key_version: "kuduclusterkey@0"
I20260811 06:51:45.734833 32658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:51:45.752612 32658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:51:45.757128 32658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:51:45.757390 32658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:51:45.758580 32658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:51:45.760250 32658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:51:45.760324 32658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:51:45.760533 32658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:51:45.760605 32658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:51:45.794946 32658 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:46047
I20260811 06:51:45.794983 418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:46047 every 8 connection(s)
I20260811 06:51:45.796356 32658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:51:45.801090 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 32658
I20260811 06:51:45.801282 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:51:45.801944 12868 external_mini_cluster.cc:1428] Setting key e3b5a777cc0eebc793deaf51689fdd8e
Aug 11 06:51:45 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431105, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:51:45.816556 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.798985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:36825 (local address 127.12.145.62:33001)
0811 06:51:45.799563 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:45.799567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:45.800296 (+ 729us) server_negotiation.cc:407] Connection header received
0811 06:51:45.802762 (+ 2466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:45.802768 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:45.802874 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:45.802967 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:51:45.804674 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.805687 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.807201 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.807642 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.807751 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.810966 (+ 3215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:51:45.810972 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:51:45.810977 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:51:45.811012 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:51:45.813460 (+ 2448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:45.814162 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:45.814168 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:45.814171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:45.814358 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:45.814788 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:45.814793 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:45.814797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:45.815046 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:51:45.815190 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:45.815956 (+ 766us) server_negotiation.cc:299] Negotiation successful
0811 06:51:45.816178 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":315,"threads_started":1}
I20260811 06:51:45.817664 424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.799323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:33001 (local address 127.12.145.3:36825)
0811 06:51:45.800113 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0811 06:51:45.800150 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 06:51:45.802470 (+ 2320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:51:45.803211 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:51:45.803219 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:51:45.803805 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:51:45.804514 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:45.804533 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.805827 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.805830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:45.807059 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:45.807071 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.807918 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.807927 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:45.808123 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.808701 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:51:45.808724 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:51:45.810757 (+ 2033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:51:45.813601 (+ 2844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:51:45.813610 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:51:45.813628 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:51:45.814052 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:51:45.814476 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:51:45.814481 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:51:45.814484 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:51:45.814679 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:51:45.815168 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:51:45.815176 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:51:45.815567 (+ 391us) client_negotiation.cc:769] Sending connection context
0811 06:51:45.815845 (+ 278us) client_negotiation.cc:240] Negotiation successful
0811 06:51:45.816355 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":359,"threads_started":1}
I20260811 06:51:45.818974 419 heartbeater.cc:347] Connected to a master server at 127.12.145.62:33001
I20260811 06:51:45.819232 419 heartbeater.cc:464] Registering TS with master...
I20260811 06:51:45.819886 419 heartbeater.cc:511] Master 127.12.145.62:33001 requested a full tablet report, sending...
I20260811 06:51:45.821154 32034 ts_manager.cc:194] Registered new tserver with Master: a92ab79813d841fd961e6199607e68a5 (127.12.145.3:46047)
I20260811 06:51:45.821956 32034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:36825
I20260811 06:51:45.829499 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:51:45.846007 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.833796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52772 (local address 127.12.145.62:33001)
0811 06:51:45.833936 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:45.833940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:45.834467 (+ 527us) server_negotiation.cc:407] Connection header received
0811 06:51:45.834588 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:45.834592 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:45.834665 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:45.834742 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:51:45.836096 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.836795 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.838058 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.838479 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.838572 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.841169 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:51:45.841174 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:51:45.841177 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:51:45.841207 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:51:45.843595 (+ 2388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:45.844314 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:45.844317 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:45.844319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:45.844471 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:45.844751 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:45.844754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:45.844756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:45.845060 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:51:45.845275 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:45.845494 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 06:51:45.845693 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 06:51:45.849833 32034 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52772:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:51:45.857542 32034 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:51:45.896384 438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.869840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:34699 (local address 127.0.0.1:39996)
0811 06:51:45.886316 (+ 16476us) negotiation.cc:107] Waiting for socket to connect
0811 06:51:45.886371 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 06:51:45.886660 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:51:45.887727 (+ 1067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:51:45.887737 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:51:45.887777 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:51:45.888407 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:45.888424 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.890840 (+ 2416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.890846 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:45.893365 (+ 2519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:45.893381 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.895212 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.895219 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:45.895460 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.895516 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 06:51:45.895648 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 06:51:45.895881 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16153,"mutex_wait_us":23,"thread_start_us":15882,"threads_started":1}
I20260811 06:51:45.897020 447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.870342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:46047 (local address 127.0.0.1:35538)
0811 06:51:45.888680 (+ 18338us) negotiation.cc:107] Waiting for socket to connect
0811 06:51:45.888707 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 06:51:45.888862 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:51:45.889532 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:51:45.889538 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:51:45.889567 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:51:45.889972 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:45.889986 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.892161 (+ 2175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.892167 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:45.894331 (+ 2164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:45.894352 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.896198 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.896205 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:45.896403 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.896435 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 06:51:45.896516 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 06:51:45.896628 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18195,"mutex_wait_us":1,"thread_start_us":18414,"threads_started":1}
I20260811 06:51:45.897173 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.870159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39996 (local address 127.12.145.1:34699)
0811 06:51:45.885601 (+ 15442us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:45.885611 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:45.886983 (+ 1372us) server_negotiation.cc:407] Connection header received
0811 06:51:45.887132 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:45.887143 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:45.887438 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:45.888684 (+ 1246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:51:45.888984 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.890649 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.893582 (+ 2933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.894933 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.895093 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.895365 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:45.896480 (+ 1115us) server_negotiation.cc:299] Negotiation successful
0811 06:51:45.896830 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15231,"thread_start_us":15062,"threads_started":1}
I20260811 06:51:45.897601 452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.871384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35538 (local address 127.12.145.3:46047)
0811 06:51:45.888126 (+ 16742us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:45.888135 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:45.889006 (+ 871us) server_negotiation.cc:407] Connection header received
0811 06:51:45.889091 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:45.889096 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:45.889312 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:45.889503 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:51:45.890447 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.892014 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.894534 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.895999 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.896121 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.896348 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:45.897059 (+ 711us) server_negotiation.cc:299] Negotiation successful
0811 06:51:45.897226 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16573,"thread_start_us":16413,"threads_started":1}
I20260811 06:51:45.898365 444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.870720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:43575 (local address 127.0.0.1:51216)
0811 06:51:45.889052 (+ 18332us) negotiation.cc:107] Waiting for socket to connect
0811 06:51:45.889073 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:51:45.889215 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:51:45.890097 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:51:45.890101 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:51:45.890126 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:51:45.890593 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:45.890607 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.891957 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.891960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:45.895488 (+ 3528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:45.895504 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.897555 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.897562 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:45.897728 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.897759 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 06:51:45.897848 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 06:51:45.897964 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18209,"mutex_wait_us":2,"thread_start_us":17660,"threads_started":1}
I20260811 06:51:45.898962 448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:45.871484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51216 (local address 127.12.145.2:43575)
0811 06:51:45.880370 (+ 8886us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:45.880381 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:45.889203 (+ 8822us) server_negotiation.cc:407] Connection header received
0811 06:51:45.889388 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:45.889396 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:45.889667 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:45.889849 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:51:45.890801 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.891805 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.895655 (+ 3850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:45.897059 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:45.897189 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:45.897383 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:45.898068 (+ 685us) server_negotiation.cc:299] Negotiation successful
0811 06:51:45.898727 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8695,"thread_start_us":8604,"threads_started":1}
I20260811 06:51:45.901675 32529 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe91f304a97421ca0bcb92ce782e03b (DEFAULT_TABLE table=test-table [id=d3293e04411944cf8bb10498c13457ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:51:45.901458 32288 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe91f304a97421ca0bcb92ce782e03b (DEFAULT_TABLE table=test-table [id=d3293e04411944cf8bb10498c13457ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:51:45.901852 313 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe91f304a97421ca0bcb92ce782e03b (DEFAULT_TABLE table=test-table [id=d3293e04411944cf8bb10498c13457ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:51:45.903016 32529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe91f304a97421ca0bcb92ce782e03b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:51:45.903095 32288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe91f304a97421ca0bcb92ce782e03b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:51:45.903514 313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe91f304a97421ca0bcb92ce782e03b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:51:45.914204 453 tablet_bootstrap.cc:492] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: Bootstrap starting.
I20260811 06:51:45.917537 455 tablet_bootstrap.cc:492] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: Bootstrap starting.
I20260811 06:51:45.918358 453 tablet_bootstrap.cc:654] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: Neither blocks nor log segments found. Creating new log.
I20260811 06:51:45.919116 454 tablet_bootstrap.cc:492] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: Bootstrap starting.
I20260811 06:51:45.919709 453 log.cc:824] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: Log is configured to *not* fsync() on all Append() calls
I20260811 06:51:45.921065 455 tablet_bootstrap.cc:654] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: Neither blocks nor log segments found. Creating new log.
I20260811 06:51:45.922323 455 log.cc:824] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: Log is configured to *not* fsync() on all Append() calls
I20260811 06:51:45.922407 454 tablet_bootstrap.cc:654] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: Neither blocks nor log segments found. Creating new log.
I20260811 06:51:45.923158 453 tablet_bootstrap.cc:492] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: No bootstrap required, opened a new log
I20260811 06:51:45.923404 453 ts_tablet_manager.cc:1397] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 06:51:45.923615 454 log.cc:824] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: Log is configured to *not* fsync() on all Append() calls
I20260811 06:51:45.925796 455 tablet_bootstrap.cc:492] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: No bootstrap required, opened a new log
I20260811 06:51:45.926189 455 ts_tablet_manager.cc:1397] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260811 06:51:45.926333 454 tablet_bootstrap.cc:492] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: No bootstrap required, opened a new log
I20260811 06:51:45.926563 454 ts_tablet_manager.cc:1397] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20260811 06:51:45.934309 453 raft_consensus.cc:348] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 } } peers { permanent_uuid: "a92ab79813d841fd961e6199607e68a5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46047 } } peers { permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 } }
I20260811 06:51:45.934773 453 raft_consensus.cc:374] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:51:45.934872 453 raft_consensus.cc:729] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58169d5b5cd74cc9be5c249afeb3a8d3, State: Initialized, Role: FOLLOWER
I20260811 06:51:45.934608 454 raft_consensus.cc:348] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 } } peers { permanent_uuid: "a92ab79813d841fd961e6199607e68a5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46047 } } peers { permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 } }
I20260811 06:51:45.935031 454 raft_consensus.cc:374] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:51:45.935151 454 raft_consensus.cc:729] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07aaff0282b0486fa2e80feb8bd8625d, State: Initialized, Role: FOLLOWER
I20260811 06:51:45.935631 453 consensus_queue.cc:260] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 } } peers { permanent_uuid: "a92ab79813d841fd961e6199607e68a5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46047 } } peers { permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 } }
I20260811 06:51:45.935878 454 consensus_queue.cc:260] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 } } peers { permanent_uuid: "a92ab79813d841fd961e6199607e68a5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46047 } } peers { permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 } }
I20260811 06:51:45.936517 455 raft_consensus.cc:348] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 } } peers { permanent_uuid: "a92ab79813d841fd961e6199607e68a5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46047 } } peers { permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 } }
I20260811 06:51:45.936947 455 raft_consensus.cc:374] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:51:45.937043 455 raft_consensus.cc:729] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92ab79813d841fd961e6199607e68a5, State: Initialized, Role: FOLLOWER
I20260811 06:51:45.937625 455 consensus_queue.cc:260] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 } } peers { permanent_uuid: "a92ab79813d841fd961e6199607e68a5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46047 } } peers { permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 } }
I20260811 06:51:45.938038 32649 heartbeater.cc:503] Master 127.12.145.62:33001 was elected leader, sending a full tablet report...
I20260811 06:51:45.938643 453 ts_tablet_manager.cc:1428] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260811 06:51:45.939760 454 ts_tablet_manager.cc:1428] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260811 06:51:45.940717 419 heartbeater.cc:503] Master 127.12.145.62:33001 was elected leader, sending a full tablet report...
I20260811 06:51:45.942822 455 ts_tablet_manager.cc:1428] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: Time spent starting tablet: real 0.017s user 0.014s sys 0.001s
W20260811 06:51:45.948016 32651 tablet.cc:2369] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:51:46.048041 420 tablet.cc:2369] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:51:46.101750 467 raft_consensus.cc:482] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:51:46.102082 467 raft_consensus.cc:504] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 } } peers { permanent_uuid: "a92ab79813d841fd961e6199607e68a5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46047 } } peers { permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 } }
I20260811 06:51:46.103734 467 leader_election.cc:288] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07aaff0282b0486fa2e80feb8bd8625d (127.12.145.1:34699), 58169d5b5cd74cc9be5c249afeb3a8d3 (127.12.145.2:43575)
I20260811 06:51:46.109907 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:46.104290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:51697 (local address 127.12.145.1:34699)
0811 06:51:46.104522 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:46.104528 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:46.104549 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:51:46.104627 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:46.104633 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:46.104708 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:46.104808 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:51:46.105240 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.106249 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.108032 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.109040 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.109176 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:46.109230 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:46.109610 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 06:51:46.109700 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 06:51:46.109999 424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:46.103997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:34699 (local address 127.12.145.3:51697)
0811 06:51:46.104225 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 06:51:46.104248 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 06:51:46.104382 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:51:46.104855 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:51:46.104860 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:51:46.104896 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:51:46.105088 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:46.105099 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.106382 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.106388 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:46.107877 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:46.107890 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.109213 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.109219 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:46.109398 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:46.109434 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 06:51:46.109589 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 06:51:46.109722 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 06:51:46.110908 448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:46.104282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:43417 (local address 127.12.145.2:43575)
0811 06:51:46.104510 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:46.104517 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:46.105057 (+ 540us) server_negotiation.cc:407] Connection header received
0811 06:51:46.105179 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:46.105185 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:46.105261 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:46.105332 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:51:46.105946 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.106806 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.108696 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.109768 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.109904 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:46.109967 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:46.110524 (+ 557us) server_negotiation.cc:299] Negotiation successful
0811 06:51:46.110662 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 06:51:46.110980 469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:46.103998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:43575 (local address 127.12.145.3:43417)
0811 06:51:46.104956 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0811 06:51:46.104973 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:51:46.105078 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:51:46.105377 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:51:46.105382 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:51:46.105406 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:51:46.105780 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:46.105791 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.106966 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.106970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:46.108542 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:51:46.108557 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.110236 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.110248 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:51:46.110374 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:46.110397 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 06:51:46.110478 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 06:51:46.110614 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"mutex_wait_us":176,"thread_start_us":434,"threads_started":1}
I20260811 06:51:46.110993 32322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe91f304a97421ca0bcb92ce782e03b" candidate_uuid: "a92ab79813d841fd961e6199607e68a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07aaff0282b0486fa2e80feb8bd8625d" is_pre_election: true
I20260811 06:51:46.111558 32322 raft_consensus.cc:2454] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92ab79813d841fd961e6199607e68a5 in term 0.
I20260811 06:51:46.111951 32568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe91f304a97421ca0bcb92ce782e03b" candidate_uuid: "a92ab79813d841fd961e6199607e68a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" is_pre_election: true
I20260811 06:51:46.112231 32686 leader_election.cc:302] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07aaff0282b0486fa2e80feb8bd8625d, a92ab79813d841fd961e6199607e68a5; no voters:
I20260811 06:51:46.112659 467 raft_consensus.cc:2781] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:51:46.112605 32568 raft_consensus.cc:2454] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a92ab79813d841fd961e6199607e68a5 in term 0.
I20260811 06:51:46.112798 467 raft_consensus.cc:482] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:51:46.112927 467 raft_consensus.cc:3037] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:51:46.115191 467 raft_consensus.cc:504] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 } } peers { permanent_uuid: "a92ab79813d841fd961e6199607e68a5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46047 } } peers { permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 } }
I20260811 06:51:46.115741 467 leader_election.cc:288] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [CANDIDATE]: Term 1 election: Requested vote from peers 07aaff0282b0486fa2e80feb8bd8625d (127.12.145.1:34699), 58169d5b5cd74cc9be5c249afeb3a8d3 (127.12.145.2:43575)
I20260811 06:51:46.116255 32322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe91f304a97421ca0bcb92ce782e03b" candidate_uuid: "a92ab79813d841fd961e6199607e68a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07aaff0282b0486fa2e80feb8bd8625d"
I20260811 06:51:46.116255 32568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe91f304a97421ca0bcb92ce782e03b" candidate_uuid: "a92ab79813d841fd961e6199607e68a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3"
I20260811 06:51:46.116465 32568 raft_consensus.cc:3037] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:51:46.116465 32322 raft_consensus.cc:3037] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:51:46.119604 32322 raft_consensus.cc:2454] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92ab79813d841fd961e6199607e68a5 in term 1.
I20260811 06:51:46.119766 32568 raft_consensus.cc:2454] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a92ab79813d841fd961e6199607e68a5 in term 1.
I20260811 06:51:46.120047 32686 leader_election.cc:302] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07aaff0282b0486fa2e80feb8bd8625d, a92ab79813d841fd961e6199607e68a5; no voters:
I20260811 06:51:46.120286 467 raft_consensus.cc:2781] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:51:46.120877 467 raft_consensus.cc:686] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 1 LEADER]: Becoming Leader. State: Replica: a92ab79813d841fd961e6199607e68a5, State: Running, Role: LEADER
I20260811 06:51:46.121301 467 consensus_queue.cc:237] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 } } peers { permanent_uuid: "a92ab79813d841fd961e6199607e68a5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46047 } } peers { permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 } }
I20260811 06:51:46.125945 32033 catalog_manager.cc:5495] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a92ab79813d841fd961e6199607e68a5 (127.12.145.3). New cstate: current_term: 1 leader_uuid: "a92ab79813d841fd961e6199607e68a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92ab79813d841fd961e6199607e68a5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 } health_report { overall_health: UNKNOWN } } }
W20260811 06:51:46.153713 32391 tablet.cc:2369] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:51:46.193382 452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:46.187227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35554 (local address 127.12.145.3:46047)
0811 06:51:46.187439 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:46.187446 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:46.187512 (+ 66us) server_negotiation.cc:407] Connection header received
0811 06:51:46.187760 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:46.187764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:46.187864 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:46.188040 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:51:46.188453 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.189252 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.191021 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.191484 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.191609 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:46.192163 (+ 554us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:51:46.192719 (+ 556us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:51:46.192872 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:46.192986 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 06:51:46.193078 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 06:51:46.202392 32568 raft_consensus.cc:1261] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3 [term 1 FOLLOWER]: Refusing update from remote peer a92ab79813d841fd961e6199607e68a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:51:46.202934 32322 raft_consensus.cc:1261] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d [term 1 FOLLOWER]: Refusing update from remote peer a92ab79813d841fd961e6199607e68a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:51:46.203430 467 consensus_queue.cc:1035] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58169d5b5cd74cc9be5c249afeb3a8d3" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:51:46.203858 471 consensus_queue.cc:1035] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07aaff0282b0486fa2e80feb8bd8625d" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:51:46.215935 474 mvcc.cc:205] Tried to move back new op lower bound from 7317221810994307072 to 7317221810677903360. Current Snapshot: MvccSnapshot[applied={T|T < 7317221810994307072}]
I20260811 06:51:46.229801 32033 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:51:46.230139 32033 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:51:46.234287 32033 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba558b0310db4993834385c0c6e9c930: Sending DeleteTablet for 3 replicas of tablet 7fe91f304a97421ca0bcb92ce782e03b
I20260811 06:51:46.235468 32529 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fe91f304a97421ca0bcb92ce782e03b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:51:46 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:51216
I20260811 06:51:46.235491 313 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fe91f304a97421ca0bcb92ce782e03b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:51:46 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:35538
I20260811 06:51:46.236153 32288 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fe91f304a97421ca0bcb92ce782e03b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:51:46 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:39996
I20260811 06:51:46.239327 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 32173
I20260811 06:51:46.246276 496 tablet_replica.cc:330] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: stopping tablet replica
I20260811 06:51:46.246502 494 tablet_replica.cc:330] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: stopping tablet replica
I20260811 06:51:46.246812 496 raft_consensus.cc:2229] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:51:46.246937 494 raft_consensus.cc:2229] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:51:46.247416 496 raft_consensus.cc:2258] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:51:46.247455 494 raft_consensus.cc:2258] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:51:46.249938 494 ts_tablet_manager.cc:1905] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:51:46.253532 496 ts_tablet_manager.cc:1905] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:51:46.258515 494 ts_tablet_manager.cc:1918] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:51:46.259200 493 tablet_replica.cc:330] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: stopping tablet replica
I20260811 06:51:46.259416 494 log.cc:1196] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/7fe91f304a97421ca0bcb92ce782e03b
I20260811 06:51:46.260001 493 raft_consensus.cc:2229] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:51:46.260578 496 ts_tablet_manager.cc:1918] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:51:46.260753 496 log.cc:1196] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/7fe91f304a97421ca0bcb92ce782e03b
I20260811 06:51:46.260877 494 ts_tablet_manager.cc:1939] T 7fe91f304a97421ca0bcb92ce782e03b P 58169d5b5cd74cc9be5c249afeb3a8d3: Deleting consensus metadata
I20260811 06:51:46.261256 496 ts_tablet_manager.cc:1939] T 7fe91f304a97421ca0bcb92ce782e03b P 07aaff0282b0486fa2e80feb8bd8625d: Deleting consensus metadata
Aug 11 06:51:46 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:51:46.263322 32018 catalog_manager.cc:4841] TS 58169d5b5cd74cc9be5c249afeb3a8d3 (127.12.145.2:43575): tablet 7fe91f304a97421ca0bcb92ce782e03b (table test-table [id=d3293e04411944cf8bb10498c13457ac]) successfully deleted
I20260811 06:51:46.263460 32014 catalog_manager.cc:4841] TS 07aaff0282b0486fa2e80feb8bd8625d (127.12.145.1:34699): tablet 7fe91f304a97421ca0bcb92ce782e03b (table test-table [id=d3293e04411944cf8bb10498c13457ac]) successfully deleted
I20260811 06:51:46.263912 493 raft_consensus.cc:2258] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:51:46.266400 493 ts_tablet_manager.cc:1905] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:51:46.270180 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:46.240669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40002 (local address 127.12.145.1:34699)
0811 06:51:46.240872 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:46.240880 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:46.251743 (+ 10863us) server_negotiation.cc:407] Connection header received
0811 06:51:46.252003 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:46.252009 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:46.252107 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:46.252192 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:51:46.254210 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.255379 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.257411 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.258145 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.258254 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:46.264006 (+ 5752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:51:46.264020 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:51:46.264039 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:51:46.264088 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:51:46.267246 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:46.267931 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:46.267938 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:46.267940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:46.268078 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:46.268462 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:46.268465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:46.268468 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:46.268829 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:51:46.269124 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:46.269478 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 06:51:46.269725 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 06:51:46.270848 32381 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:51:46.273712 493 ts_tablet_manager.cc:1918] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:51:46.273895 493 log.cc:1196] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/7fe91f304a97421ca0bcb92ce782e03b
I20260811 06:51:46.274470 493 ts_tablet_manager.cc:1939] T 7fe91f304a97421ca0bcb92ce782e03b P a92ab79813d841fd961e6199607e68a5: Deleting consensus metadata
I20260811 06:51:46.276365 32015 catalog_manager.cc:4841] TS a92ab79813d841fd961e6199607e68a5 (127.12.145.3:46047): tablet 7fe91f304a97421ca0bcb92ce782e03b (table test-table [id=d3293e04411944cf8bb10498c13457ac]) successfully deleted
I20260811 06:51:46.366614 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 32173
I20260811 06:51:46.391412 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 32398
Aug 11 06:51:46 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:51:46.407593 448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:46.392278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51226 (local address 127.12.145.2:43575)
0811 06:51:46.392498 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:46.392505 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:46.392527 (+ 22us) server_negotiation.cc:407] Connection header received
0811 06:51:46.392595 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:46.392601 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:46.392699 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:46.392807 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:51:46.394060 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.395253 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.396644 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.397265 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.397400 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:46.401830 (+ 4430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:51:46.401845 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:51:46.401863 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:51:46.401901 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:51:46.404645 (+ 2744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:46.405503 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:46.405510 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:46.405622 (+ 112us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:46.405752 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:46.406208 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:46.406211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:46.406213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:46.406572 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:51:46.406790 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:46.407155 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 06:51:46.407314 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 06:51:46.408483 32643 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:51:46.497251 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 32398
I20260811 06:51:46.521379 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 32658
Aug 11 06:51:46 dist-test-slave-7lbf krb5kdc[31217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:51:46.540215 452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:51:46.522191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35562 (local address 127.12.145.3:46047)
0811 06:51:46.522345 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 06:51:46.522349 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:51:46.522367 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:51:46.522573 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:51:46.522577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:51:46.522659 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:51:46.522734 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:51:46.524754 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.525594 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.527572 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:51:46.528011 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:51:46.528109 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:51:46.533814 (+ 5705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:51:46.533828 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:51:46.533844 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:51:46.533891 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:51:46.536933 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:46.537690 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:46.537700 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:46.537709 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:46.537955 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:51:46.538352 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:51:46.538358 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:51:46.538362 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:51:46.538906 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:51:46.539272 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0811 06:51:46.539482 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 06:51:46.539734 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 06:51:46.540995 408 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:51:46.662103 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 32658
I20260811 06:51:46.689780 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 31984
I20260811 06:51:46.691018 32086 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:51:46.808737 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 31984
I20260811 06:51:46.837179 12868 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 06:51:47.183535 12868 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 06:51:47.183808 12868 mini_ranger.cc:66] Stopping Ranger...
I20260811 06:51:47.529066 12868 mini_ranger.cc:68] Stopped Ranger
2026-08-11 06:51:47.529 UTC [31261] LOG: received smart shutdown request
2026-08-11 06:51:47.533 UTC [31261] LOG: background worker "logical replication launcher" (PID 31281) exited with exit code 1
2026-08-11 06:51:47.533 UTC [31267] LOG: shutting down
2026-08-11 06:51:47.677 UTC [31261] LOG: database system is shut down
2026-08-11T06:51:47Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50320 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:51:47 dist-test-slave-7lbf krb5kdc[517](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:51:47 dist-test-slave-7lbf krb5kdc[517](info): set up 2 sockets
Aug 11 06:51:47 dist-test-slave-7lbf krb5kdc[517](info): commencing operation
krb5kdc: starting...
W20260811 06:51:49.023407 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:51:49 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:51:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:51:49Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.145.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.145.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/rangeradmin_127.12.145.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/rangeradmin_127.12.145.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.145.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.145.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/rangerlookup_127.12.145.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/rangerlookup_127.12.145.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.145.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.145.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/HTTP_127.12.145.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/HTTP_127.12.145.20@KRBTEST.COM.keytab.
I20260811 06:51:49.394469 12868 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskuXC_ag/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/postgres -l logfile start
2026-08-11 06:51:51.751 UTC [570] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 06:51:51.751 UTC [570] LOG: listening on IPv4 address "127.12.145.20", port 34829
2026-08-11 06:51:51.754 UTC [570] LOG: listening on Unix socket "/tmp/.s.PGSQL.34829"
2026-08-11 06:51:51.776 UTC [575] LOG: database system was shut down at 2026-08-11 06:51:50 UTC
2026-08-11 06:51:51.780 UTC [570] LOG: database system is ready to accept connections
I20260811 06:51:52.883109 12868 mini_postgres.cc:96] Postgres bound to 34829
2026-08-11 06:51:52.905 UTC [591] FATAL: database "slave" does not exist
127.12.145.20:34829 - accepting connections
I20260811 06:51:52.905699 12868 mini_ranger.cc:161] Starting Ranger...
I20260811 06:51:52.935318 12868 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 06:51:53.379792 12868 mini_ranger.cc:87] Created ranger Postgres database
I20260811 06:51:53.379916 12868 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-admin
2026-08-11 06:51:53,676 [I] DB FLAVOR :POSTGRES
2026-08-11 06:51:53,677 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 06:51:53,677 [I] Checking connection..
2026-08-11 06:51:53,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 06:51:53,944 [I] Checking connection passed.
2026-08-11 06:51:53,944 [I] --------- Verifying version history table ---------
2026-08-11 06:51:53,945 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 06:51:54,193 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 06:51:54,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 06:51:54,445 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 06:51:54,445 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 06:51:54,445 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 06:51:54.705 UTC [708] WARNING: there is no transaction in progress
2026-08-11 06:51:54,711 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 06:51:54,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 06:51:54,968 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 06:51:54,968 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 06:51:54,969 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 06:51:55,221 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 06:51:55,461 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7lbf.c.gcp-upstream.internal','N') ;"
2026-08-11 06:51:55,691 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 06:51:55,934 [I] Table x_portal_user does not exist in database ranger
2026-08-11 06:51:55,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 06:51:56,191 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 06:51:56,192 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 06:51:56,437 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 06:51:56,668 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 06:51:56,668 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 06:51:57.596 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.611 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.626 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.640 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.659 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.675 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.727 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.734 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.747 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.756 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.766 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.777 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.786 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.795 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.801 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:57.807 UTC [895] WARNING: there is no transaction in progress
2026-08-11 06:51:58,388 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 06:51:58,388 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 06:51:58,643 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 06:51:58,643 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 06:51:58,911 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 06:51:58,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 06:51:59,161 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 06:51:59,161 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 06:51:59,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 06:51:59,636 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7lbf.c.gcp-upstream.internal';"
2026-08-11 06:51:59,890 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 06:51:59,890 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 06:52:00,149 [I] DB_PATCHES have already been applied
I20260811 06:52:00.155226 12868 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-admin:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskuXC_ag/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 06:52:00.155339 12868 mini_ranger.cc:193] Using host: 127.12.145.20
I20260811 06:52:00.174886 12868 mini_ranger.cc:227] Ranger admin URL: http://127.12.145.20:55461
Aug 11, 2026 6:52:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:52:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:52:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 6:52:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 6:52:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 6:52:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 6:52:01 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 06:52:01.484032 12868 mini_ranger.cc:160] Time spent starting Ranger: real 8.578s user 0.001s sys 0.055s
Aug 11, 2026 6:52:21 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 6:52:21 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 6:52:21 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 6:52:21 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 6:52:22 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 06:52:23.213250 12868 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.145.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.145.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/rangerkms_127.12.145.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.145.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/rangerkms_127.12.145.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.145.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.145.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.145.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/HTTP_127.12.145.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.145.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/HTTP_127.12.145.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 06:52:23 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431143, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 06:52:23.427554 12868 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 06:52:23.452545 12868 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 06:52:24.257349 12868 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 06:52:24.257480 12868 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-kms
I20260811 06:52:24.257541 12868 mini_ranger_kms.cc:227] Using postgres at 127.12.145.20:34829
2026-08-11 06:52:24,608 [I] DB FLAVOR :POSTGRES
2026-08-11 06:52:24,608 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 06:52:24,608 [I] Checking connection
2026-08-11 06:52:24,608 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 06:52:24,854 [I] connection success
2026-08-11 06:52:24,854 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 06:52:24,854 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 06:52:24,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 06:52:25,086 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 06:52:25,086 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 06:52:25,086 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 06:52:25,086 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.20:34829/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 06:52:25,356 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 06:52:25.810957 12868 mini_ranger_kms.cc:310] Created kms service
I20260811 06:52:25.982525 12868 mini_ranger_kms.cc:326] Created kudu user
I20260811 06:52:26.028170 12868 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 06:52:26 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431143, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:26.420182 12868 mini_ranger_kms.cc:384] Added ranger policy
I20260811 06:52:26.420553 12868 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-kms:/tmp/dist-test-taskuXC_ag/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskuXC_ag/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 06:52:26.420625 12868 mini_ranger_kms.cc:240] Using host: 127.12.145.20
I20260811 06:52:26.444752 12868 mini_ranger_kms.cc:276] Ranger KMS PID: 1192
I20260811 06:52:26.444873 12868 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.145.20:35707
Aug 11, 2026 6:52:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:52:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:52:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 6:52:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 6:52:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 6:52:27 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 06:52:28 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786431148, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 06:52:29 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431148, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.20@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:29.125907 12868 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.698s user 0.072s sys 0.313s
I20260811 06:52:29.126148 12868 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 06:52:29.126303 12868 mini_ranger_kms.cc:401] 127.12.145.20:35707/kms/v1/keys
Aug 11 06:52:29 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431148, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.20@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
Aug 11 06:52:31 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:52:31.866372 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:36429
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:36429
--ranger_config_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:35707/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:32.216197 1279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:32.216514 1279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:32.216603 1279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:32.223923 1279 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:52:32.224043 1279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:32.224089 1279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:32.224149 1279 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:52:32.224197 1279 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:52:32.234738 1279 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.145.20:35707/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:36429
--ranger_config_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:36429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:32.236032 1279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:32.237335 1279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:32.249835 1285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:32.249770 1286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:32.249790 1289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:32.250188 1279 server_base.cc:1034] running on GCE node
I20260811 06:52:32.251180 1279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:32.252570 1279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:32.253770 1279 hybrid_clock.cc:648] HybridClock initialized: now 1786431152253724 us; error 36 us; skew 500 ppm
I20260811 06:52:32.254134 1279 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:32 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431152, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:32.257256 1279 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:52:32.258774 1279 webserver.cc:460] Webserver started at http://127.12.145.62:33231/ using document root <none> and password file <none>
I20260811 06:52:32.259431 1279 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:32.259544 1279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:32.259860 1279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 06:52:32 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431152, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:32.315371 1279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "aeaebb6de99e412e96327a7e2ff02a08"
format_stamp: "Formatted at 2026-08-11 06:52:32 on dist-test-slave-7lbf"
server_key: "8ab6f3aef40c4d23f7a3fc7d92c3e910"
server_key_iv: "0a74adceb767d12a2a6e28f7a6dfb298"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:32.316282 1279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "aeaebb6de99e412e96327a7e2ff02a08"
format_stamp: "Formatted at 2026-08-11 06:52:32 on dist-test-slave-7lbf"
server_key: "8ab6f3aef40c4d23f7a3fc7d92c3e910"
server_key_iv: "0a74adceb767d12a2a6e28f7a6dfb298"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:32.322016 1279 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:52:32.338824 1299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:32.340257 1279 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:52:32.340466 1279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "aeaebb6de99e412e96327a7e2ff02a08"
format_stamp: "Formatted at 2026-08-11 06:52:32 on dist-test-slave-7lbf"
server_key: "8ab6f3aef40c4d23f7a3fc7d92c3e910"
server_key_iv: "0a74adceb767d12a2a6e28f7a6dfb298"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:32.340703 1279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:32.359076 1279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:32.362790 1279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:32.363112 1279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:32.380839 1279 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:36429
I20260811 06:52:32.380841 1393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:36429 every 8 connection(s)
I20260811 06:52:32.382283 1279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:52:32.385244 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 1279
I20260811 06:52:32.385457 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:52:32.386160 12868 external_mini_cluster.cc:1428] Setting key a09cd984de266709dd89d657b8e9c33a
I20260811 06:52:32.386415 1394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:32.400573 1394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: Bootstrap starting.
Aug 11 06:52:32 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:32.404434 1394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:32.405942 1394 log.cc:824] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:32.409569 1394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: No bootstrap required, opened a new log
I20260811 06:52:32.410738 1397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:32.388101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51124 (local address 127.12.145.62:36429)
0811 06:52:32.388872 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:32.388884 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:32.388928 (+ 44us) server_negotiation.cc:407] Connection header received
0811 06:52:32.390984 (+ 2056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:32.391008 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:32.391415 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:32.391758 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:32.393433 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:32.394789 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:32.396587 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:32.397320 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:32.397453 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:32.402296 (+ 4843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:32.402312 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:32.402333 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:32.402385 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:32.406133 (+ 3748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:32.406961 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:32.406975 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:32.406982 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:32.407149 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:32.407583 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:32.407588 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:32.407591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:32.408287 (+ 696us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:32.408585 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:32.408925 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 06:52:32.409345 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":357,"threads_started":1}
I20260811 06:52:32.417479 1394 raft_consensus.cc:348] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } }
I20260811 06:52:32.417884 1394 raft_consensus.cc:374] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:32.417968 1394 raft_consensus.cc:729] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeaebb6de99e412e96327a7e2ff02a08, State: Initialized, Role: FOLLOWER
I20260811 06:52:32.418498 1394 consensus_queue.cc:260] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } }
I20260811 06:52:32.418705 1394 raft_consensus.cc:388] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:52:32.418804 1394 raft_consensus.cc:482] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:52:32.418929 1394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:32.421078 1394 raft_consensus.cc:504] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } }
I20260811 06:52:32.421595 1394 leader_election.cc:302] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aeaebb6de99e412e96327a7e2ff02a08; no voters:
I20260811 06:52:32.422142 1394 leader_election.cc:288] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:52:32.422266 1400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:52:32.422945 1400 raft_consensus.cc:686] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 1 LEADER]: Becoming Leader. State: Replica: aeaebb6de99e412e96327a7e2ff02a08, State: Running, Role: LEADER
I20260811 06:52:32.423489 1400 consensus_queue.cc:237] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } }
I20260811 06:52:32.424154 1394 sys_catalog.cc:564] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:52:32.426321 1403 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aeaebb6de99e412e96327a7e2ff02a08. Latest consensus state: current_term: 1 leader_uuid: "aeaebb6de99e412e96327a7e2ff02a08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } } }
I20260811 06:52:32.426716 1403 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:32.429690 1402 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aeaebb6de99e412e96327a7e2ff02a08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } } }
I20260811 06:52:32.429939 1402 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:32.430488 1412 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:52:32.435374 1412 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:52:32.436123 1394 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 06:52:32.452943 1412 catalog_manager.cc:1347] Generated new cluster ID: eb413a4a44fd4cdbade289279573f43b
I20260811 06:52:32.453100 1412 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:52:32.530104 1412 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:52:32.532189 1412 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:52:32.546087 1412 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: Generated new TSK 0
I20260811 06:52:32.547372 1412 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:52:33.317022 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:35707/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:36429
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:52:33 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786431153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 06:52:33.735399 1481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:33.735991 1481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:33.736195 1481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:33.744932 1481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:33.745066 1481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:33.745229 1481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:52:33.757025 1481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.145.20:35707/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:36429
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:33.759052 1481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:33.760425 1481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:33.778805 1499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:33.780493 1498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:33.786948 1481 server_base.cc:1034] running on GCE node
W20260811 06:52:33.786935 1503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:33.787985 1481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:33.789105 1481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:33.790373 1481 hybrid_clock.cc:648] HybridClock initialized: now 1786431153790307 us; error 60 us; skew 500 ppm
I20260811 06:52:33.790727 1481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:33 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:33.794047 1481 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:52:33.801669 1481 webserver.cc:460] Webserver started at http://127.12.145.1:36245/ using document root <none> and password file <none>
I20260811 06:52:33.802440 1481 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:33.802565 1481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:33.802938 1481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 06:52:33 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:33.823807 1481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "661eb850e8d94d3d98bd71ad0975217b"
format_stamp: "Formatted at 2026-08-11 06:52:33 on dist-test-slave-7lbf"
server_key: "a1e9908bd1234604f0e70ee5f2af32b8"
server_key_iv: "a0cad44d7106aaf19dbe6b141e8ef3bf"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:33.826442 1481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "661eb850e8d94d3d98bd71ad0975217b"
format_stamp: "Formatted at 2026-08-11 06:52:33 on dist-test-slave-7lbf"
server_key: "a1e9908bd1234604f0e70ee5f2af32b8"
server_key_iv: "a0cad44d7106aaf19dbe6b141e8ef3bf"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:33.851826 1481 fs_manager.cc:691] Time spent creating directory manager: real 0.025s user 0.015s sys 0.008s
I20260811 06:52:33.871409 1515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:33.873157 1481 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:52:33.873368 1481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "661eb850e8d94d3d98bd71ad0975217b"
format_stamp: "Formatted at 2026-08-11 06:52:33 on dist-test-slave-7lbf"
server_key: "a1e9908bd1234604f0e70ee5f2af32b8"
server_key_iv: "a0cad44d7106aaf19dbe6b141e8ef3bf"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:33.873677 1481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:33.898275 1481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:33.903563 1481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:33.903863 1481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:33.919665 1481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:33.922181 1481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:33.922345 1481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:33.922536 1481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:33.922618 1481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:33.992902 1481 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:33095
I20260811 06:52:33.992883 1695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:33095 every 8 connection(s)
I20260811 06:52:33.994436 1481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:52:33.996222 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 1481
I20260811 06:52:33.996459 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:52:33.997330 12868 external_mini_cluster.cc:1428] Setting key 8bc3baa1fb096c2edacd24cfd8851892
Aug 11 06:52:34 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
I20260811 06:52:34.042747 1704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:34.003616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:36537 (local address 127.12.145.62:36429)
0811 06:52:34.012657 (+ 9041us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:34.012663 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:34.016703 (+ 4040us) server_negotiation.cc:407] Connection header received
0811 06:52:34.019709 (+ 3006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:34.019717 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:34.019822 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:34.019945 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:34.022661 (+ 2716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:34.023874 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:34.028003 (+ 4129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:34.028695 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:34.028813 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:34.033886 (+ 5073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:34.033894 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:34.033899 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:34.033959 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:34.037789 (+ 3830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:34.038892 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:34.038898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:34.038901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:34.039103 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:34.039773 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:34.039778 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:34.039781 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:34.040199 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:34.040376 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:34.042092 (+ 1716us) server_negotiation.cc:299] Negotiation successful
0811 06:52:34.042346 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8891,"thread_start_us":8741,"threads_started":1}
I20260811 06:52:34.045635 1703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:34.002442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36429 (local address 127.12.145.1:36537)
0811 06:52:34.016457 (+ 14015us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:34.016533 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:34.019226 (+ 2693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:34.020633 (+ 1407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:34.020647 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:34.021406 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:34.022405 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:34.022439 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:34.024169 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:34.024175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:34.027779 (+ 3604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:34.027798 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:34.029226 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:34.029234 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:34.029579 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:34.030487 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:34.030523 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:34.033575 (+ 3052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:34.037977 (+ 4402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:34.037989 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:34.038010 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:34.038703 (+ 693us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:34.039318 (+ 615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:34.039323 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:34.039327 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:34.039606 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:34.040370 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:34.040378 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:34.040902 (+ 524us) client_negotiation.cc:769] Sending connection context
0811 06:52:34.043207 (+ 2305us) client_negotiation.cc:240] Negotiation successful
0811 06:52:34.043821 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13614,"thread_start_us":13356,"threads_started":1}
I20260811 06:52:34.047821 1697 heartbeater.cc:347] Connected to a master server at 127.12.145.62:36429
I20260811 06:52:34.048190 1697 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:34.049175 1697 heartbeater.cc:511] Master 127.12.145.62:36429 requested a full tablet report, sending...
I20260811 06:52:34.052009 1333 ts_manager.cc:194] Registered new tserver with Master: 661eb850e8d94d3d98bd71ad0975217b (127.12.145.1:33095)
I20260811 06:52:34.054173 1333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:36537
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:52:34.085707 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:35707/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:36429
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:52:34 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
Aug 11 06:52:34 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431153, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
W20260811 06:52:34.609834 1707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:34.610394 1707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:34.610634 1707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:34.622632 1707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:34.622859 1707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:34.623106 1707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:52:34.638863 1707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.145.20:35707/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:36429
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:34.641027 1707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:34.642974 1707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:34.678150 1720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:34.679970 1717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:34.689283 1707 server_base.cc:1034] running on GCE node
W20260811 06:52:34.689800 1725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:34.690801 1707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:34.703763 1707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:34.707276 1707 hybrid_clock.cc:648] HybridClock initialized: now 1786431154707137 us; error 131 us; skew 500 ppm
I20260811 06:52:34.707782 1707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:34 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431154, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:34.712633 1707 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:52:34.742034 1707 webserver.cc:460] Webserver started at http://127.12.145.2:39881/ using document root <none> and password file <none>
I20260811 06:52:34.743260 1707 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:34.743438 1707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:34.743965 1707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 06:52:34 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431154, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:34.771872 1707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "f48763eb8d0e4711a101dac5b0aad12c"
format_stamp: "Formatted at 2026-08-11 06:52:34 on dist-test-slave-7lbf"
server_key: "a6e70e6d749f56993d7bea5164f80d57"
server_key_iv: "428b2098f1429490f926429df3a83574"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:34.773443 1707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "f48763eb8d0e4711a101dac5b0aad12c"
format_stamp: "Formatted at 2026-08-11 06:52:34 on dist-test-slave-7lbf"
server_key: "a6e70e6d749f56993d7bea5164f80d57"
server_key_iv: "428b2098f1429490f926429df3a83574"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:34.780994 1707 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260811 06:52:34.809217 1748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:34.811751 1707 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.009s sys 0.004s
I20260811 06:52:34.811965 1707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "f48763eb8d0e4711a101dac5b0aad12c"
format_stamp: "Formatted at 2026-08-11 06:52:34 on dist-test-slave-7lbf"
server_key: "a6e70e6d749f56993d7bea5164f80d57"
server_key_iv: "428b2098f1429490f926429df3a83574"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:34.812208 1707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:34.825999 1707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:34.830125 1707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:34.830403 1707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:34.831493 1707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:34.833063 1707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:34.833146 1707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:34.833266 1707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:34.833320 1707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:34.868841 1707 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:45069
I20260811 06:52:34.868858 1939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:45069 every 8 connection(s)
I20260811 06:52:34.870340 1707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:52:34.880632 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 1707
I20260811 06:52:34.880843 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:52:34.881446 12868 external_mini_cluster.cc:1428] Setting key 8ccd24475eb57cb31751c07b4ed2277d
Aug 11 06:52:34 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431154, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:34.890712 1942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:34.873243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:40103 (local address 127.12.145.62:36429)
0811 06:52:34.873702 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:34.873707 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:34.874885 (+ 1178us) server_negotiation.cc:407] Connection header received
0811 06:52:34.876701 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:34.876707 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:34.876806 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:34.876907 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:34.878451 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:34.879227 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:34.880905 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:34.881317 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:34.881439 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:34.884961 (+ 3522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:34.884967 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:34.884970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:34.885001 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:34.887533 (+ 2532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:34.888258 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:34.888262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:34.888265 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:34.888385 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:34.888822 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:34.888826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:34.888829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:34.889154 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:34.889303 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:34.890077 (+ 774us) server_negotiation.cc:299] Negotiation successful
0811 06:52:34.890316 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":260,"threads_started":1}
I20260811 06:52:34.891736 1944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:34.873949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36429 (local address 127.12.145.2:40103)
0811 06:52:34.874723 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:34.874762 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:34.876425 (+ 1663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:34.877162 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:34.877170 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:34.877671 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:34.878281 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:34.878301 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:34.879385 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:34.879389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:34.880761 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:34.880778 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:34.881588 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:34.881597 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:34.881884 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:34.882645 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:34.882670 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:34.884744 (+ 2074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:34.887673 (+ 2929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:34.887684 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:34.887702 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:34.888133 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:34.888492 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:34.888497 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:34.888501 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:34.888701 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:34.889284 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:34.889293 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:34.889690 (+ 397us) client_negotiation.cc:769] Sending connection context
0811 06:52:34.889944 (+ 254us) client_negotiation.cc:240] Negotiation successful
0811 06:52:34.890485 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":314,"threads_started":1}
I20260811 06:52:34.893278 1940 heartbeater.cc:347] Connected to a master server at 127.12.145.62:36429
I20260811 06:52:34.893630 1940 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:34.894431 1940 heartbeater.cc:511] Master 127.12.145.62:36429 requested a full tablet report, sending...
I20260811 06:52:34.895879 1333 ts_manager.cc:194] Registered new tserver with Master: f48763eb8d0e4711a101dac5b0aad12c (127.12.145.2:45069)
I20260811 06:52:34.896956 1333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:40103
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:52:34.945305 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:35707/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:36429
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:52:35.058252 1697 heartbeater.cc:503] Master 127.12.145.62:36429 was elected leader, sending a full tablet report...
W20260811 06:52:35.288038 1949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:35.288337 1949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:35.288487 1949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:35.295923 1949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:35.296047 1949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:35.296195 1949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:52:35.306167 1949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.145.20:35707/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:36429
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:35.307499 1949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:35.308822 1949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:35.321852 1959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:35.321774 1961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:35.321833 1958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:35.322902 1949 server_base.cc:1034] running on GCE node
I20260811 06:52:35.323484 1949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:35.324518 1949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:35.325739 1949 hybrid_clock.cc:648] HybridClock initialized: now 1786431155325681 us; error 38 us; skew 500 ppm
I20260811 06:52:35.326066 1949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:35 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431155, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:35.329123 1949 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:52:35.330633 1949 webserver.cc:460] Webserver started at http://127.12.145.3:32793/ using document root <none> and password file <none>
I20260811 06:52:35.331369 1949 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:35.331504 1949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:35.331842 1949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 06:52:35 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431155, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:35.347075 1949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "5fac848be3c847c1851f60be5671998e"
format_stamp: "Formatted at 2026-08-11 06:52:35 on dist-test-slave-7lbf"
server_key: "ba5a3efa9f351b8d4f11e1986d2d12a7"
server_key_iv: "9ce64d796d47ca51d2bbb8a3687dc26a"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:35.347956 1949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "5fac848be3c847c1851f60be5671998e"
format_stamp: "Formatted at 2026-08-11 06:52:35 on dist-test-slave-7lbf"
server_key: "ba5a3efa9f351b8d4f11e1986d2d12a7"
server_key_iv: "9ce64d796d47ca51d2bbb8a3687dc26a"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:35.353713 1949 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:52:35.371181 1977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:35.372787 1949 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 06:52:35.373018 1949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "5fac848be3c847c1851f60be5671998e"
format_stamp: "Formatted at 2026-08-11 06:52:35 on dist-test-slave-7lbf"
server_key: "ba5a3efa9f351b8d4f11e1986d2d12a7"
server_key_iv: "9ce64d796d47ca51d2bbb8a3687dc26a"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:35.373251 1949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:35.386504 1949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:35.390442 1949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:35.390744 1949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:35.391690 1949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:35.393092 1949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:35.393172 1949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:35.393297 1949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:35.393356 1949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:35.424528 1949 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:42483
I20260811 06:52:35.424582 2163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:42483 every 8 connection(s)
I20260811 06:52:35.425911 1949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:52:35.433775 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 1949
I20260811 06:52:35.433952 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:52:35.434437 12868 external_mini_cluster.cc:1428] Setting key 907014d0b51f31a7653bcbb24707388d
Aug 11 06:52:35 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431155, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:35.445396 2168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:35.428450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:40975 (local address 127.12.145.62:36429)
0811 06:52:35.428905 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:35.428909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:35.429892 (+ 983us) server_negotiation.cc:407] Connection header received
0811 06:52:35.431738 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:35.431744 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:35.431841 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:35.431943 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:35.433381 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:35.434207 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:35.435841 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:35.436446 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:35.436577 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:35.439968 (+ 3391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:35.439973 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:35.439976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:35.440010 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:35.442600 (+ 2590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:35.443271 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:35.443276 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:35.443278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:35.443412 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:35.443849 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:35.443855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:35.443858 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:35.444156 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:35.444277 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:35.444923 (+ 646us) server_negotiation.cc:299] Negotiation successful
0811 06:52:35.445130 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":212,"threads_started":1}
I20260811 06:52:35.446329 2170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:35.429026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36429 (local address 127.12.145.3:40975)
0811 06:52:35.429744 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:35.429782 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:35.431481 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:35.432180 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:35.432188 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:35.432629 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:35.433197 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:35.433216 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:35.434359 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:35.434363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:35.435651 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:35.435668 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:35.436688 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:35.436698 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:35.437008 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:35.437748 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:35.437772 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:35.439764 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:35.442720 (+ 2956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:35.442727 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:35.442739 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:35.443153 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:35.443497 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:35.443500 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:35.443502 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:35.443688 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:35.444283 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:35.444289 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:35.444588 (+ 299us) client_negotiation.cc:769] Sending connection context
0811 06:52:35.444811 (+ 223us) client_negotiation.cc:240] Negotiation successful
0811 06:52:35.445224 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":275,"threads_started":1}
I20260811 06:52:35.447604 2165 heartbeater.cc:347] Connected to a master server at 127.12.145.62:36429
I20260811 06:52:35.447890 2165 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:35.448729 2165 heartbeater.cc:511] Master 127.12.145.62:36429 requested a full tablet report, sending...
I20260811 06:52:35.450294 1333 ts_manager.cc:194] Registered new tserver with Master: 5fac848be3c847c1851f60be5671998e (127.12.145.3:42483)
I20260811 06:52:35.451084 1333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:40975
I20260811 06:52:35.462373 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:52:35.464187 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 1481
Aug 11 06:52:35 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:52:35.480723 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:35.465097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56462 (local address 127.12.145.1:33095)
0811 06:52:35.465767 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:35.465774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:35.465801 (+ 27us) server_negotiation.cc:407] Connection header received
0811 06:52:35.465869 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:35.465875 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:35.466072 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:35.466208 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:35.467588 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:35.468629 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:35.470121 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:35.470710 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:35.470811 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:35.475101 (+ 4290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:35.475116 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:35.475131 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:35.475171 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:35.478135 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:35.478826 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:35.478833 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:35.478835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:35.478988 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:35.479286 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:35.479289 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:35.479290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:35.479651 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:35.479974 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:35.480173 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 06:52:35.480413 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":341,"threads_started":1}
I20260811 06:52:35.482033 1691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:35.565310 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 1481
I20260811 06:52:35.589926 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 1707
Aug 11 06:52:35 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:52:35.605798 2177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:35.590941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46030 (local address 127.12.145.2:45069)
0811 06:52:35.591480 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:35.591487 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:35.591514 (+ 27us) server_negotiation.cc:407] Connection header received
0811 06:52:35.591578 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:35.591585 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:35.591810 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:35.591939 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:35.593214 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:35.594283 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:35.595542 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:35.596104 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:35.596204 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:35.600305 (+ 4101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:35.600318 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:35.600334 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:35.600381 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:35.603244 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:35.603885 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:35.603892 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:35.603894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:35.604036 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:35.604308 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:35.604311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:35.604313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:35.604674 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:35.604892 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:35.605182 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 06:52:35.605397 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":266,"threads_started":1}
I20260811 06:52:35.607069 1933 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:35.688324 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 1707
I20260811 06:52:35.709769 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 1949
Aug 11 06:52:35 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:52:35.725999 2180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:35.710944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35872 (local address 127.12.145.3:42483)
0811 06:52:35.711592 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:35.711599 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:35.711630 (+ 31us) server_negotiation.cc:407] Connection header received
0811 06:52:35.711691 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:35.711698 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:35.711914 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:35.712046 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:35.713352 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:35.714422 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:35.715734 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:35.716288 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:35.716382 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:35.720759 (+ 4377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:35.720772 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:35.720796 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:35.720839 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:35.723494 (+ 2655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:35.724130 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:35.724137 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:35.724139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:35.724271 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:35.724572 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:35.724575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:35.724578 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:35.724953 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:35.725198 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:35.725428 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 06:52:35.725672 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":331,"threads_started":1}
I20260811 06:52:35.727303 2159 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:35.808985 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 1949
I20260811 06:52:35.828369 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 1279
I20260811 06:52:35.829727 1385 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:35.936937 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 1279
I20260811 06:52:35.972788 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:36429
--webserver_interface=127.12.145.62
--webserver_port=33231
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:36429
--ranger_config_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:35707/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.145.20:35707/kms with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:36.297416 2187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:36.297736 2187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:36.297874 2187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:36.304929 2187 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:52:36.305044 2187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:36.305125 2187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:36.305202 2187 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:52:36.305267 2187 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:52:36.315423 2187 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.145.20:35707/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:36429
--ranger_config_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:36429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=33231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:36.316655 2187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:36.317987 2187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:36.329213 2196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:36.329289 2195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:36.329250 2201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:36.330236 2187 server_base.cc:1034] running on GCE node
I20260811 06:52:36.331012 2187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:36.332391 2187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:36.333647 2187 hybrid_clock.cc:648] HybridClock initialized: now 1786431156333603 us; error 31 us; skew 500 ppm
I20260811 06:52:36.334021 2187 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:36 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431156, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:36.337224 2187 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:52:36.338649 2187 webserver.cc:460] Webserver started at http://127.12.145.62:33231/ using document root <none> and password file <none>
I20260811 06:52:36.339259 2187 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:36.339368 2187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 06:52:36 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431156, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:36.420783 2187 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 06:52:36.423806 2209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:36.425161 2187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:52:36.425326 2187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "aeaebb6de99e412e96327a7e2ff02a08"
format_stamp: "Formatted at 2026-08-11 06:52:32 on dist-test-slave-7lbf"
server_key: "8ab6f3aef40c4d23f7a3fc7d92c3e910"
server_key_iv: "0a74adceb767d12a2a6e28f7a6dfb298"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:36.426352 2187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:36.446728 2187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:36.450663 2187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:36.450930 2187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:36.468039 2187 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:36429
I20260811 06:52:36.468058 2292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:36429 every 8 connection(s)
I20260811 06:52:36.469475 2187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:52:36.476373 2293 sys_catalog.cc:263] Verifying existing consensus state
I20260811 06:52:36.477818 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 2187
I20260811 06:52:36.478891 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:35707/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:33095
--local_ip_for_outbound_sockets=127.12.145.1
--tserver_master_addrs=127.12.145.62:36429
--webserver_port=36245
--webserver_interface=127.12.145.1
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.145.20:35707/kms with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:52:36.480741 2293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: Bootstrap starting.
I20260811 06:52:36.501461 2293 log.cc:824] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:36.510670 2293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 06:52:36.511184 2293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: Bootstrap complete.
I20260811 06:52:36.520048 2293 raft_consensus.cc:348] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } }
I20260811 06:52:36.520903 2293 raft_consensus.cc:729] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeaebb6de99e412e96327a7e2ff02a08, State: Initialized, Role: FOLLOWER
I20260811 06:52:36.521479 2293 consensus_queue.cc:260] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } }
I20260811 06:52:36.521778 2293 raft_consensus.cc:388] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:52:36.521888 2293 raft_consensus.cc:482] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:52:36.522056 2293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:52:36.526315 2293 raft_consensus.cc:504] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } }
I20260811 06:52:36.526808 2293 leader_election.cc:302] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aeaebb6de99e412e96327a7e2ff02a08; no voters:
I20260811 06:52:36.527397 2293 leader_election.cc:288] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 06:52:36.527546 2299 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 06:52:36.528704 2299 raft_consensus.cc:686] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [term 2 LEADER]: Becoming Leader. State: Replica: aeaebb6de99e412e96327a7e2ff02a08, State: Running, Role: LEADER
I20260811 06:52:36.529327 2299 consensus_queue.cc:237] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } }
I20260811 06:52:36.529651 2293 sys_catalog.cc:564] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:52:36.535091 2300 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "aeaebb6de99e412e96327a7e2ff02a08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } } }
I20260811 06:52:36.535614 2300 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:36.535868 2301 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aeaebb6de99e412e96327a7e2ff02a08. Latest consensus state: current_term: 2 leader_uuid: "aeaebb6de99e412e96327a7e2ff02a08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aeaebb6de99e412e96327a7e2ff02a08" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36429 } } }
I20260811 06:52:36.536814 2301 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:36.538139 2306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:52:36.549829 2306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:52:36.551452 2306 catalog_manager.cc:1259] Loaded cluster ID: eb413a4a44fd4cdbade289279573f43b
I20260811 06:52:36.551649 2306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:52:36.555888 2306 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:52:36.557708 2306 catalog_manager.cc:5879] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: Loaded TSK: 0
I20260811 06:52:36.559366 2306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:52:36.564204 2293 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260811 06:52:36.958660 2297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:36.959059 2297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:36.959280 2297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:36.970661 2297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:36.970877 2297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:36.971105 2297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:52:36.986822 2297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.145.20:35707/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:33095
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=36245
--tserver_master_addrs=127.12.145.62:36429
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:36.988775 2297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:36.990741 2297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:37.025105 2350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:37.025713 2351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:37.032352 2353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:37.033878 2297 server_base.cc:1034] running on GCE node
I20260811 06:52:37.035048 2297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:37.038563 2297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:37.039876 2297 hybrid_clock.cc:648] HybridClock initialized: now 1786431157039795 us; error 64 us; skew 500 ppm
I20260811 06:52:37.040350 2297 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:37 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:37.044966 2297 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:52:37.048026 2297 webserver.cc:460] Webserver started at http://127.12.145.1:36245/ using document root <none> and password file <none>
I20260811 06:52:37.049108 2297 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:37.049297 2297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 06:52:37 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:37.106769 2297 fs_manager.cc:709] Time spent opening directory manager: real 0.019s user 0.010s sys 0.005s
I20260811 06:52:37.111671 2367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:37.113763 2297 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260811 06:52:37.113997 2297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "661eb850e8d94d3d98bd71ad0975217b"
format_stamp: "Formatted at 2026-08-11 06:52:33 on dist-test-slave-7lbf"
server_key: "a1e9908bd1234604f0e70ee5f2af32b8"
server_key_iv: "a0cad44d7106aaf19dbe6b141e8ef3bf"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:37.115537 2297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:37.161772 2297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:37.167655 2297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:37.168052 2297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:37.169199 2297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:37.172010 2297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:37.172114 2297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:37.172228 2297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:37.172303 2297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:37.228032 2297 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:33095
I20260811 06:52:37.228055 2558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:33095 every 8 connection(s)
I20260811 06:52:37.230106 2297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:52:37.237442 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 2297
I20260811 06:52:37.238353 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:35707/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:45069
--local_ip_for_outbound_sockets=127.12.145.2
--tserver_master_addrs=127.12.145.62:36429
--webserver_port=39881
--webserver_interface=127.12.145.2
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.145.20:35707/kms with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:52:37 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:37.264318 2561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:37.233348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36429 (local address 127.12.145.1:46365)
0811 06:52:37.234211 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:37.234267 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:37.236358 (+ 2091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:37.238821 (+ 2463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:37.238831 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:37.239452 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:37.240273 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:37.240298 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:37.242952 (+ 2654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:37.242958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:37.244804 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:37.244820 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:37.246309 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:37.246316 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:37.246577 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:37.247390 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:37.247420 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:37.253956 (+ 6536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:37.258523 (+ 4567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:37.258533 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:37.258551 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:37.259435 (+ 884us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:37.260170 (+ 735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:37.260175 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:37.260178 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:37.260442 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:37.261492 (+ 1050us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:37.261500 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:37.261932 (+ 432us) client_negotiation.cc:769] Sending connection context
0811 06:52:37.262240 (+ 308us) client_negotiation.cc:240] Negotiation successful
0811 06:52:37.262865 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":363,"threads_started":1}
I20260811 06:52:37.272116 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:37.233424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:46365 (local address 127.12.145.62:36429)
0811 06:52:37.237121 (+ 3697us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:37.237139 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:37.237193 (+ 54us) server_negotiation.cc:407] Connection header received
0811 06:52:37.237700 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:37.237720 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:37.238223 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:37.240550 (+ 2327us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:37.240964 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:37.242759 (+ 1795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:37.245044 (+ 2285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:37.246056 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:37.247073 (+ 1017us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:37.254358 (+ 7285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:37.254373 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:37.254400 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:37.254466 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:37.258322 (+ 3856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:37.259707 (+ 1385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:37.259739 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:37.259748 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:37.260033 (+ 285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:37.260591 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:37.260596 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:37.260598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:37.261340 (+ 742us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:37.269855 (+ 8515us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:37.270171 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 06:52:37.270678 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3408,"thread_start_us":3145,"threads_started":1}
I20260811 06:52:37.275519 2559 heartbeater.cc:347] Connected to a master server at 127.12.145.62:36429
I20260811 06:52:37.275867 2559 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:37.276811 2559 heartbeater.cc:511] Master 127.12.145.62:36429 requested a full tablet report, sending...
W20260811 06:52:37.280289 2559 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:36429 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 06:52:37.280537 2559 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:37.280810 2559 heartbeater.cc:511] Master 127.12.145.62:36429 requested a full tablet report, sending...
I20260811 06:52:37.282137 2559 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:37.282491 2559 heartbeater.cc:511] Master 127.12.145.62:36429 requested a full tablet report, sending...
W20260811 06:52:37.283583 2559 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 06:52:37.769224 2563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:37.769666 2563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:37.769833 2563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:37.781579 2563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:37.781810 2563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:37.782065 2563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:52:37.797636 2563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.145.20:35707/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:45069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=39881
--tserver_master_addrs=127.12.145.62:36429
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:37.799566 2563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:37.801317 2563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:37.818781 2592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:37.819528 2593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:37.825011 2563 server_base.cc:1034] running on GCE node
W20260811 06:52:37.825345 2599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:37.826229 2563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:37.827605 2563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:37.828910 2563 hybrid_clock.cc:648] HybridClock initialized: now 1786431157828823 us; error 69 us; skew 500 ppm
I20260811 06:52:37.829330 2563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:37 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:37.833900 2563 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:52:37.847368 2563 webserver.cc:460] Webserver started at http://127.12.145.2:39881/ using document root <none> and password file <none>
I20260811 06:52:37.848501 2563 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:37.848680 2563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 06:52:37 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786431157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 06:52:37 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:37.888475 2563 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.003s sys 0.000s
I20260811 06:52:37.892671 2612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:37.894485 2563 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 06:52:37.894732 2563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "f48763eb8d0e4711a101dac5b0aad12c"
format_stamp: "Formatted at 2026-08-11 06:52:34 on dist-test-slave-7lbf"
server_key: "a6e70e6d749f56993d7bea5164f80d57"
server_key_iv: "428b2098f1429490f926429df3a83574"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:37.896268 2563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:37.959756 2563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:37.965013 2563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:37.965354 2563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:37.966646 2563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:37.968441 2563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:37.968568 2563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:37.968690 2563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:37.968775 2563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:38.044456 2563 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:45069
I20260811 06:52:38.044545 2810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:45069 every 8 connection(s)
I20260811 06:52:38.046541 2563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:52:38.054728 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 2563
I20260811 06:52:38.055624 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.20:35707/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:42483
--local_ip_for_outbound_sockets=127.12.145.3
--tserver_master_addrs=127.12.145.62:36429
--webserver_port=32793
--webserver_interface=127.12.145.3
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.145.20:35707/kms with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:52:38 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:38.090360 2818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:38.052217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:41299 (local address 127.12.145.62:36429)
0811 06:52:38.066087 (+ 13870us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:38.066094 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:38.066122 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:52:38.066470 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:38.066477 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:38.066573 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:38.066682 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:38.069106 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.070342 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.072980 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.073709 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.073833 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:38.082467 (+ 8634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:38.082477 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:38.082483 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:38.082531 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:38.086261 (+ 3730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:38.087392 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:38.087398 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:38.087402 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:38.087574 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:38.088140 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:38.088145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:38.088149 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:38.088526 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:38.088653 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:38.089685 (+ 1032us) server_negotiation.cc:299] Negotiation successful
0811 06:52:38.089938 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13708,"thread_start_us":16263,"threads_started":1}
I20260811 06:52:38.093140 2817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:38.051568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36429 (local address 127.12.145.2:41299)
0811 06:52:38.058230 (+ 6662us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:38.058287 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:38.061218 (+ 2931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:38.067190 (+ 5972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:38.067203 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:38.067932 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:38.068878 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:38.068909 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.070567 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.070574 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:38.072797 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:38.072817 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.074158 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.074166 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:38.074482 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:38.079028 (+ 4546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:38.079064 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:38.082090 (+ 3026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:38.086516 (+ 4426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:38.086527 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:38.086548 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:38.087215 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:38.087708 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:38.087714 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:38.087718 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:38.088003 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:38.088737 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:38.088746 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:38.089215 (+ 469us) client_negotiation.cc:769] Sending connection context
0811 06:52:38.090974 (+ 1759us) client_negotiation.cc:240] Negotiation successful
0811 06:52:38.091641 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6275,"thread_start_us":10092,"threads_started":1}
I20260811 06:52:38.095342 2812 heartbeater.cc:347] Connected to a master server at 127.12.145.62:36429
I20260811 06:52:38.095681 2812 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:38.096596 2812 heartbeater.cc:511] Master 127.12.145.62:36429 requested a full tablet report, sending...
I20260811 06:52:38.098781 2238 ts_manager.cc:194] Registered new tserver with Master: f48763eb8d0e4711a101dac5b0aad12c (127.12.145.2:45069)
I20260811 06:52:38.101074 2238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:41299
I20260811 06:52:38.283767 2559 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:38.284240 2559 heartbeater.cc:511] Master 127.12.145.62:36429 requested a full tablet report, sending...
I20260811 06:52:38.285693 2238 ts_manager.cc:194] Registered new tserver with Master: 661eb850e8d94d3d98bd71ad0975217b (127.12.145.1:33095)
I20260811 06:52:38.286888 2238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:46365
Aug 11 06:52:38 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
W20260811 06:52:38.533365 2820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:38.533866 2820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:38.534045 2820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:38.545712 2820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:38.545862 2820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:38.546109 2820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:52:38.562052 2820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.145.20:35707/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:42483
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=32793
--tserver_master_addrs=127.12.145.62:36429
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:38.563982 2820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:38.565826 2820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:38.583014 2826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:38.583870 2828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:38.588320 2820 server_base.cc:1034] running on GCE node
W20260811 06:52:38.588733 2831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:38.589536 2820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:38.591171 2820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:38.592449 2820 hybrid_clock.cc:648] HybridClock initialized: now 1786431158592374 us; error 70 us; skew 500 ppm
I20260811 06:52:38.592790 2820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:38 dist-test-slave-7lbf krb5kdc[517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431158, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:38.596210 2820 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:52:38.598069 2820 webserver.cc:460] Webserver started at http://127.12.145.3:32793/ using document root <none> and password file <none>
I20260811 06:52:38.598817 2820 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:38.598958 2820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 06:52:38 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431158, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:38.621763 2820 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.006s sys 0.000s
I20260811 06:52:38.638166 2841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:38.640311 2820 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.008s sys 0.007s
I20260811 06:52:38.640558 2820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "5fac848be3c847c1851f60be5671998e"
format_stamp: "Formatted at 2026-08-11 06:52:35 on dist-test-slave-7lbf"
server_key: "ba5a3efa9f351b8d4f11e1986d2d12a7"
server_key_iv: "9ce64d796d47ca51d2bbb8a3687dc26a"
server_key_version: "kuduclusterkey@0"
I20260811 06:52:38.642141 2820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:38.664585 2820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
Aug 11 06:52:38 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431157, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for HTTP/127.12.145.20@KRBTEST.COM
I20260811 06:52:38.670594 2820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:38.671005 2820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:38.675295 2820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:38.683637 2820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:38.683792 2820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:38.683945 2820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:38.684036 2820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:38.930747 2820 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:42483
I20260811 06:52:38.930804 3016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:42483 every 8 connection(s)
I20260811 06:52:38.932479 2820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:52:38.936815 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 2820
Aug 11 06:52:38 dist-test-slave-7lbf krb5kdc[517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431158, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:38.971115 3024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:38.938467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57526 (local address 127.12.145.62:36429)
0811 06:52:38.950628 (+ 12161us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:38.950635 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:38.950660 (+ 25us) server_negotiation.cc:407] Connection header received
0811 06:52:38.950737 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:38.950743 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:38.950847 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:38.951002 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:38.952751 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.953986 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.956142 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.956810 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.956950 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:38.961289 (+ 4339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:38.961296 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:38.961300 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:38.961380 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:38.965335 (+ 3955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:38.966580 (+ 1245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:38.966587 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:38.966591 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:38.966742 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:38.967265 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:38.967271 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:38.967274 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:38.968260 (+ 986us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:38.968528 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:38.970187 (+ 1659us) server_negotiation.cc:299] Negotiation successful
0811 06:52:38.970428 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11992,"thread_start_us":12654,"threads_started":1}
I20260811 06:52:38.977644 3020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:38.935524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:34867 (local address 127.12.145.62:36429)
0811 06:52:38.941260 (+ 5736us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:38.941267 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:38.957361 (+ 16094us) server_negotiation.cc:407] Connection header received
0811 06:52:38.957426 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:38.957431 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:38.957549 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:38.957652 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:38.960109 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.961305 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.963905 (+ 2600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.964619 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.964752 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:38.969006 (+ 4254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:38.969014 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:38.969019 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:38.969061 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:38.972508 (+ 3447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:38.973630 (+ 1122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:38.973636 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:38.973639 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:38.973799 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:38.974393 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:38.974398 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:38.974402 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:38.974772 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:38.974921 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:38.976935 (+ 2014us) server_negotiation.cc:299] Negotiation successful
0811 06:52:38.977198 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5596,"thread_start_us":5474,"threads_started":1}
I20260811 06:52:38.977701 3022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:38.936270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:36429 (local address 127.12.145.3:34867)
0811 06:52:38.954233 (+ 17963us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:38.954294 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:38.956941 (+ 2647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:38.958226 (+ 1285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:38.958240 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:38.958947 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:38.959867 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:38.959898 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.961510 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.961541 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:38.963710 (+ 2169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:38.963730 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.965124 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.965133 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:38.965457 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:38.966187 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:38.966226 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:38.968708 (+ 2482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:38.972694 (+ 3986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:38.972704 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:38.972725 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:38.973395 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:38.973934 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:38.973940 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:38.973943 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:38.974244 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:38.974929 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:38.974938 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:38.975440 (+ 502us) client_negotiation.cc:769] Sending connection context
0811 06:52:38.975806 (+ 366us) client_negotiation.cc:240] Negotiation successful
0811 06:52:38.976323 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17617,"thread_start_us":17374,"threads_started":1}
I20260811 06:52:38.979233 3018 heartbeater.cc:347] Connected to a master server at 127.12.145.62:36429
I20260811 06:52:38.979557 3018 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:38.980317 3018 heartbeater.cc:511] Master 127.12.145.62:36429 requested a full tablet report, sending...
I20260811 06:52:38.981875 2238 ts_manager.cc:194] Registered new tserver with Master: 5fac848be3c847c1851f60be5671998e (127.12.145.3:42483)
I20260811 06:52:38.982717 2238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:34867
I20260811 06:52:38.987044 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:52:39.005105 3020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:38.990611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57534 (local address 127.12.145.62:36429)
0811 06:52:38.990796 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:38.990802 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:38.991273 (+ 471us) server_negotiation.cc:407] Connection header received
0811 06:52:38.991420 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:38.991426 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:38.991507 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:38.991607 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:38.993078 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.994244 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.995581 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:38.996206 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:38.996353 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:38.998947 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:38.998955 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:38.998960 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:38.999002 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:39.002428 (+ 3426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:39.003090 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:39.003096 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:39.003100 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:39.003266 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:39.003633 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:39.003638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:39.003642 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:39.004020 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:39.004284 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:39.004526 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 06:52:39.004780 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 06:52:39.010456 2238 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:52:39.018151 2238 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:52:39.073386 3051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.060733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:33095 (local address 127.0.0.1:39730)
0811 06:52:39.065374 (+ 4641us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:39.065393 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:39.065496 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:39.067222 (+ 1726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:39.067225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:39.067245 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:39.067521 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:39.067529 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.068883 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.068887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:39.070453 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:39.070466 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.072409 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.072416 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:39.072624 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.072685 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 06:52:39.072806 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 06:52:39.073011 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4513,"thread_start_us":2243,"threads_started":1}
I20260811 06:52:39.074020 3055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.034499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58672 (local address 127.12.145.3:42483)
0811 06:52:39.058279 (+ 23780us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:39.058289 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:39.062955 (+ 4666us) server_negotiation.cc:407] Connection header received
0811 06:52:39.063457 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:39.063466 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:39.063741 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:39.063949 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:39.066692 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.068359 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.071142 (+ 2783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.072570 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.072694 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.072912 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:39.073487 (+ 575us) server_negotiation.cc:299] Negotiation successful
0811 06:52:39.073684 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23572,"thread_start_us":23806,"threads_started":1}
I20260811 06:52:39.075441 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.061088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39730 (local address 127.12.145.1:33095)
0811 06:52:39.066409 (+ 5321us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:39.066417 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:39.066447 (+ 30us) server_negotiation.cc:407] Connection header received
0811 06:52:39.066546 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:39.066554 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:39.066787 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:39.067005 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:39.067714 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.068739 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.070618 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.071869 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.072005 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.072255 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:39.073997 (+ 1742us) server_negotiation.cc:299] Negotiation successful
0811 06:52:39.074967 (+ 970us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5139,"thread_start_us":5684,"threads_started":1}
I20260811 06:52:39.074776 3056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.033959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:42483 (local address 127.0.0.1:58672)
0811 06:52:39.062826 (+ 28867us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:39.062851 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:39.063229 (+ 378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:39.064337 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:39.064358 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:39.064389 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:39.064805 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:39.064818 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.068569 (+ 3751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.068575 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:39.070966 (+ 2391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:39.070982 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.073075 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.073081 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:39.073261 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.073290 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 06:52:39.074242 (+ 952us) client_negotiation.cc:240] Negotiation successful
0811 06:52:39.074382 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28741,"thread_start_us":25845,"threads_started":1}
I20260811 06:52:39.079592 2915 tablet_service.cc:1467] Processing CreateTablet for tablet 0dc722dc6ef24de1932849f12a9bdba4 (DEFAULT_TABLE table=test-table [id=4c82f536800b427b8250aa55a83a719b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:52:39.079985 2451 tablet_service.cc:1467] Processing CreateTablet for tablet 0dc722dc6ef24de1932849f12a9bdba4 (DEFAULT_TABLE table=test-table [id=4c82f536800b427b8250aa55a83a719b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:52:39.081089 2915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dc722dc6ef24de1932849f12a9bdba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:39.081709 2451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dc722dc6ef24de1932849f12a9bdba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:39.082260 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.033648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:45069 (local address 127.0.0.1:44890)
0811 06:52:39.059189 (+ 25541us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:39.059275 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:39.059488 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:39.071179 (+ 11691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:39.071184 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:39.071211 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:39.071538 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:39.071550 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.073731 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.073736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:39.075802 (+ 2066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:39.075818 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.081440 (+ 5622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.081447 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:39.081661 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.081701 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 06:52:39.081776 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 06:52:39.081920 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25169,"thread_start_us":31449,"threads_started":1}
I20260811 06:52:39.083521 3052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.033908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44890 (local address 127.12.145.2:45069)
0811 06:52:39.066067 (+ 32159us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:39.066076 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:39.066105 (+ 29us) server_negotiation.cc:407] Connection header received
0811 06:52:39.066197 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:39.066204 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:39.066462 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:39.071737 (+ 5275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:39.071983 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.073578 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.076529 (+ 2951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.081162 (+ 4633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.082666 (+ 1504us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.082915 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:39.083007 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 06:52:39.083185 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31985,"thread_start_us":31795,"threads_started":1}
I20260811 06:52:39.087523 2698 tablet_service.cc:1467] Processing CreateTablet for tablet 0dc722dc6ef24de1932849f12a9bdba4 (DEFAULT_TABLE table=test-table [id=4c82f536800b427b8250aa55a83a719b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:52:39.089222 2698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dc722dc6ef24de1932849f12a9bdba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:39.104702 3059 tablet_bootstrap.cc:492] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: Bootstrap starting.
I20260811 06:52:39.106277 2812 heartbeater.cc:503] Master 127.12.145.62:36429 was elected leader, sending a full tablet report...
I20260811 06:52:39.112191 3059 tablet_bootstrap.cc:654] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:39.113154 3061 tablet_bootstrap.cc:492] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: Bootstrap starting.
I20260811 06:52:39.117769 3061 tablet_bootstrap.cc:654] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:39.118312 3062 tablet_bootstrap.cc:492] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: Bootstrap starting.
I20260811 06:52:39.119248 3061 log.cc:824] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:39.119266 3059 log.cc:824] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:39.122268 3062 tablet_bootstrap.cc:654] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:39.123754 3062 log.cc:824] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:39.126442 3061 tablet_bootstrap.cc:492] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: No bootstrap required, opened a new log
I20260811 06:52:39.126775 3061 ts_tablet_manager.cc:1397] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.006s
I20260811 06:52:39.140247 3061 raft_consensus.cc:348] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 } } peers { permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 } } peers { permanent_uuid: "661eb850e8d94d3d98bd71ad0975217b" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 33095 } }
I20260811 06:52:39.140769 3062 tablet_bootstrap.cc:492] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: No bootstrap required, opened a new log
I20260811 06:52:39.140779 3059 tablet_bootstrap.cc:492] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: No bootstrap required, opened a new log
I20260811 06:52:39.140982 3061 raft_consensus.cc:374] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:39.141103 3062 ts_tablet_manager.cc:1397] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.016s
I20260811 06:52:39.141108 3059 ts_tablet_manager.cc:1397] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: Time spent bootstrapping tablet: real 0.037s user 0.014s sys 0.007s
I20260811 06:52:39.141201 3061 raft_consensus.cc:729] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fac848be3c847c1851f60be5671998e, State: Initialized, Role: FOLLOWER
I20260811 06:52:39.142117 3061 consensus_queue.cc:260] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 } } peers { permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 } } peers { permanent_uuid: "661eb850e8d94d3d98bd71ad0975217b" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 33095 } }
I20260811 06:52:39.150583 3061 ts_tablet_manager.cc:1428] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: Time spent starting tablet: real 0.024s user 0.016s sys 0.004s
I20260811 06:52:39.151036 3018 heartbeater.cc:503] Master 127.12.145.62:36429 was elected leader, sending a full tablet report...
I20260811 06:52:39.151681 3062 raft_consensus.cc:348] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 } } peers { permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 } } peers { permanent_uuid: "661eb850e8d94d3d98bd71ad0975217b" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 33095 } }
I20260811 06:52:39.152120 3062 raft_consensus.cc:374] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:39.152208 3062 raft_consensus.cc:729] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f48763eb8d0e4711a101dac5b0aad12c, State: Initialized, Role: FOLLOWER
I20260811 06:52:39.152138 3059 raft_consensus.cc:348] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 } } peers { permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 } } peers { permanent_uuid: "661eb850e8d94d3d98bd71ad0975217b" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 33095 } }
I20260811 06:52:39.152587 3059 raft_consensus.cc:374] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:39.152736 3059 raft_consensus.cc:729] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 661eb850e8d94d3d98bd71ad0975217b, State: Initialized, Role: FOLLOWER
I20260811 06:52:39.152912 3062 consensus_queue.cc:260] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 } } peers { permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 } } peers { permanent_uuid: "661eb850e8d94d3d98bd71ad0975217b" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 33095 } }
I20260811 06:52:39.153508 3059 consensus_queue.cc:260] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 } } peers { permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 } } peers { permanent_uuid: "661eb850e8d94d3d98bd71ad0975217b" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 33095 } }
I20260811 06:52:39.157678 2559 heartbeater.cc:503] Master 127.12.145.62:36429 was elected leader, sending a full tablet report...
I20260811 06:52:39.158707 3059 ts_tablet_manager.cc:1428] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: Time spent starting tablet: real 0.017s user 0.017s sys 0.001s
I20260811 06:52:39.161295 3062 ts_tablet_manager.cc:1428] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: Time spent starting tablet: real 0.020s user 0.014s sys 0.003s
W20260811 06:52:39.190948 3019 tablet.cc:2369] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:52:39.233160 2560 tablet.cc:2369] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:52:39.316779 2814 tablet.cc:2369] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:52:39.345790 3069 raft_consensus.cc:482] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:52:39.346140 3069 raft_consensus.cc:504] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 } } peers { permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 } } peers { permanent_uuid: "661eb850e8d94d3d98bd71ad0975217b" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 33095 } }
I20260811 06:52:39.347929 3069 leader_election.cc:288] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f48763eb8d0e4711a101dac5b0aad12c (127.12.145.2:45069), 5fac848be3c847c1851f60be5671998e (127.12.145.3:42483)
I20260811 06:52:39.356773 3055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.348451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:49847 (local address 127.12.145.3:42483)
0811 06:52:39.348637 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:39.348644 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:39.349443 (+ 799us) server_negotiation.cc:407] Connection header received
0811 06:52:39.349607 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:39.349612 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:39.349682 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:39.349778 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:39.350495 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.351619 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.354500 (+ 2881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.355703 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.355878 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.355956 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:39.356358 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 06:52:39.356493 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 06:52:39.356760 3052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.348424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:47559 (local address 127.12.145.2:45069)
0811 06:52:39.348638 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:39.348644 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:39.349345 (+ 701us) server_negotiation.cc:407] Connection header received
0811 06:52:39.349590 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:39.349596 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:39.349676 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:39.349778 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:39.350507 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.351621 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.354506 (+ 2885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.355737 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.355882 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.355956 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:39.356358 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 06:52:39.356493 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 06:52:39.357009 3070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.348241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:45069 (local address 127.12.145.1:47559)
0811 06:52:39.349215 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:39.349237 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:39.349409 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:39.349813 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:39.349818 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:39.349848 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:39.350389 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:39.350398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.351742 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.351747 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:39.354334 (+ 2587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:39.354351 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.355980 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.355986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:39.356178 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.356223 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 06:52:39.356319 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 06:52:39.356511 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":828,"mutex_wait_us":224,"thread_start_us":600,"threads_started":1}
I20260811 06:52:39.357029 3071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.348341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:42483 (local address 127.12.145.1:49847)
0811 06:52:39.349330 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:39.349365 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:39.349478 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:39.349813 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:39.349818 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:39.349913 (+ 95us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:39.350327 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:39.350344 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.351739 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.351744 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:39.354334 (+ 2590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:39.354351 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.355952 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.355959 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:39.356170 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.356230 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 06:52:39.356317 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 06:52:39.356511 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":880,"mutex_wait_us":180,"spinlock_wait_cycles":25856,"thread_start_us":502,"threads_started":1}
I20260811 06:52:39.358155 2734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc722dc6ef24de1932849f12a9bdba4" candidate_uuid: "661eb850e8d94d3d98bd71ad0975217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f48763eb8d0e4711a101dac5b0aad12c" is_pre_election: true
I20260811 06:52:39.358304 2945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc722dc6ef24de1932849f12a9bdba4" candidate_uuid: "661eb850e8d94d3d98bd71ad0975217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fac848be3c847c1851f60be5671998e" is_pre_election: true
I20260811 06:52:39.358682 2734 raft_consensus.cc:2454] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 661eb850e8d94d3d98bd71ad0975217b in term 0.
I20260811 06:52:39.358805 2945 raft_consensus.cc:2454] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 661eb850e8d94d3d98bd71ad0975217b in term 0.
I20260811 06:52:39.359397 2372 leader_election.cc:302] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 661eb850e8d94d3d98bd71ad0975217b, f48763eb8d0e4711a101dac5b0aad12c; no voters:
I20260811 06:52:39.359803 3069 raft_consensus.cc:2781] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:52:39.359961 3069 raft_consensus.cc:482] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:52:39.360069 3069 raft_consensus.cc:3037] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:39.362663 3069 raft_consensus.cc:504] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 } } peers { permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 } } peers { permanent_uuid: "661eb850e8d94d3d98bd71ad0975217b" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 33095 } }
I20260811 06:52:39.363361 3069 leader_election.cc:288] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [CANDIDATE]: Term 1 election: Requested vote from peers f48763eb8d0e4711a101dac5b0aad12c (127.12.145.2:45069), 5fac848be3c847c1851f60be5671998e (127.12.145.3:42483)
I20260811 06:52:39.363832 2734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc722dc6ef24de1932849f12a9bdba4" candidate_uuid: "661eb850e8d94d3d98bd71ad0975217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f48763eb8d0e4711a101dac5b0aad12c"
I20260811 06:52:39.363858 2945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dc722dc6ef24de1932849f12a9bdba4" candidate_uuid: "661eb850e8d94d3d98bd71ad0975217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fac848be3c847c1851f60be5671998e"
I20260811 06:52:39.364030 2734 raft_consensus.cc:3037] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:39.364045 2945 raft_consensus.cc:3037] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:39.366252 2734 raft_consensus.cc:2454] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 661eb850e8d94d3d98bd71ad0975217b in term 1.
I20260811 06:52:39.366400 2945 raft_consensus.cc:2454] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 661eb850e8d94d3d98bd71ad0975217b in term 1.
I20260811 06:52:39.366652 2372 leader_election.cc:302] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 661eb850e8d94d3d98bd71ad0975217b, f48763eb8d0e4711a101dac5b0aad12c; no voters:
I20260811 06:52:39.366947 3069 raft_consensus.cc:2781] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:52:39.368418 3069 raft_consensus.cc:686] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 1 LEADER]: Becoming Leader. State: Replica: 661eb850e8d94d3d98bd71ad0975217b, State: Running, Role: LEADER
I20260811 06:52:39.368928 3069 consensus_queue.cc:237] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 } } peers { permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 } } peers { permanent_uuid: "661eb850e8d94d3d98bd71ad0975217b" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 33095 } }
I20260811 06:52:39.374320 2237 catalog_manager.cc:5495] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b reported cstate change: term changed from 0 to 1, leader changed from <none> to 661eb850e8d94d3d98bd71ad0975217b (127.12.145.1). New cstate: current_term: 1 leader_uuid: "661eb850e8d94d3d98bd71ad0975217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "661eb850e8d94d3d98bd71ad0975217b" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 33095 } health_report { overall_health: HEALTHY } } }
I20260811 06:52:39.413735 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.408759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39740 (local address 127.12.145.1:33095)
0811 06:52:39.408941 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:39.408945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:39.409013 (+ 68us) server_negotiation.cc:407] Connection header received
0811 06:52:39.409194 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:39.409198 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:39.409294 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:39.409425 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:52:39.409793 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.410526 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.411820 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.412219 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.412310 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.412733 (+ 423us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:52:39.413260 (+ 527us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:52:39.413376 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:39.413417 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 06:52:39.413486 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 06:52:39.422030 2945 raft_consensus.cc:1261] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e [term 1 FOLLOWER]: Refusing update from remote peer 661eb850e8d94d3d98bd71ad0975217b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:52:39.422044 2734 raft_consensus.cc:1261] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c [term 1 FOLLOWER]: Refusing update from remote peer 661eb850e8d94d3d98bd71ad0975217b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:52:39.423046 3073 consensus_queue.cc:1035] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f48763eb8d0e4711a101dac5b0aad12c" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:52:39.423384 3069 consensus_queue.cc:1035] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fac848be3c847c1851f60be5671998e" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:52:39.449348 2238 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:52:39.449687 2238 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:52:39.453438 2238 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aeaebb6de99e412e96327a7e2ff02a08: Sending DeleteTablet for 3 replicas of tablet 0dc722dc6ef24de1932849f12a9bdba4
I20260811 06:52:39.454766 2698 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dc722dc6ef24de1932849f12a9bdba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:52:39 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:44890
I20260811 06:52:39.454773 2915 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dc722dc6ef24de1932849f12a9bdba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:52:39 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:58672
I20260811 06:52:39.455572 2451 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dc722dc6ef24de1932849f12a9bdba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:52:39 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:39730
I20260811 06:52:39.456007 3098 tablet_replica.cc:330] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: stopping tablet replica
I20260811 06:52:39.456439 3098 raft_consensus.cc:2229] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:52:39.456995 3098 raft_consensus.cc:2258] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:52:39.458683 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 2297
I20260811 06:52:39.459540 3098 ts_tablet_manager.cc:1905] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:52:39.461941 3100 tablet_replica.cc:330] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: stopping tablet replica
I20260811 06:52:39.462186 3102 tablet_replica.cc:330] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: stopping tablet replica
I20260811 06:52:39.462653 3102 raft_consensus.cc:2229] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:52:39.463413 3102 raft_consensus.cc:2258] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:52:39.468051 3098 ts_tablet_manager.cc:1918] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:52:39.468226 3098 log.cc:1196] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/0dc722dc6ef24de1932849f12a9bdba4
I20260811 06:52:39.468729 3098 ts_tablet_manager.cc:1939] T 0dc722dc6ef24de1932849f12a9bdba4 P f48763eb8d0e4711a101dac5b0aad12c: Deleting consensus metadata
I20260811 06:52:39.470111 3102 ts_tablet_manager.cc:1905] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:52:39.462385 3100 raft_consensus.cc:2229] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:52:39.470600 2215 catalog_manager.cc:4841] TS f48763eb8d0e4711a101dac5b0aad12c (127.12.145.2:45069): tablet 0dc722dc6ef24de1932849f12a9bdba4 (table test-table [id=4c82f536800b427b8250aa55a83a719b]) successfully deleted
I20260811 06:52:39.470870 3100 raft_consensus.cc:2258] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:52:39.478708 3102 ts_tablet_manager.cc:1918] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:52:39.480983 3100 ts_tablet_manager.cc:1905] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:52:39.485735 3102 log.cc:1196] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/0dc722dc6ef24de1932849f12a9bdba4
I20260811 06:52:39.486444 3102 ts_tablet_manager.cc:1939] T 0dc722dc6ef24de1932849f12a9bdba4 P 661eb850e8d94d3d98bd71ad0975217b: Deleting consensus metadata
I20260811 06:52:39.484604 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.461186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39744 (local address 127.12.145.1:33095)
0811 06:52:39.461375 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:39.461381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:39.461412 (+ 31us) server_negotiation.cc:407] Connection header received
0811 06:52:39.461476 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:39.461481 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:39.461584 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:39.461687 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:39.467656 (+ 5969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.468869 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.471252 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.471905 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.472011 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.475620 (+ 3609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:39.475634 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:39.475653 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:39.475693 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:39.480180 (+ 4487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:39.481145 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:39.481156 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:39.481159 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:39.481361 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:39.481884 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:39.481906 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:39.481910 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:39.482399 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:39.482723 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:39.483914 (+ 1191us) server_negotiation.cc:299] Negotiation successful
0811 06:52:39.484243 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 06:52:39.487496 2548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:39.487527 3100 ts_tablet_manager.cc:1918] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:52:39.487705 3100 log.cc:1196] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/0dc722dc6ef24de1932849f12a9bdba4
I20260811 06:52:39.488349 3100 ts_tablet_manager.cc:1939] T 0dc722dc6ef24de1932849f12a9bdba4 P 5fac848be3c847c1851f60be5671998e: Deleting consensus metadata
I20260811 06:52:39.490682 2211 catalog_manager.cc:4841] TS 5fac848be3c847c1851f60be5671998e (127.12.145.3:42483): tablet 0dc722dc6ef24de1932849f12a9bdba4 (table test-table [id=4c82f536800b427b8250aa55a83a719b]) successfully deleted
I20260811 06:52:39.587595 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 2297
I20260811 06:52:39.587785 2211 catalog_manager.cc:4841] TS 661eb850e8d94d3d98bd71ad0975217b (127.12.145.1:33095): tablet 0dc722dc6ef24de1932849f12a9bdba4 (table test-table [id=4c82f536800b427b8250aa55a83a719b]) successfully deleted
I20260811 06:52:39.611017 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 2563
I20260811 06:52:39.624122 3052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.611863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44904 (local address 127.12.145.2:45069)
0811 06:52:39.612039 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:39.612043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:39.612063 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:52:39.612167 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:39.612172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:39.612239 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:39.612319 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:39.613579 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.614309 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.615683 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.616080 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.616172 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.618788 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:39.618803 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:39.618820 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:39.618861 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:39.621697 (+ 2836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:39.622337 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:39.622343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:39.622345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:39.622489 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:39.622768 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:39.622770 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:39.622772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:39.623157 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:39.623388 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:39.623593 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 06:52:39.623768 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:52:39.624828 2804 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:39.715142 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 2563
I20260811 06:52:39.740872 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 2820
I20260811 06:52:39.754889 3055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:39.741692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58688 (local address 127.12.145.3:42483)
0811 06:52:39.741905 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:39.741911 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:39.741975 (+ 64us) server_negotiation.cc:407] Connection header received
0811 06:52:39.742180 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:39.742186 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:39.742256 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:39.742355 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:39.743910 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.744695 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.746101 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:39.746485 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:39.746600 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:39.749162 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:39.749176 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:39.749193 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:39.749234 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:39.751801 (+ 2567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:39.752607 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:39.752615 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:39.752617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:39.752772 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:39.753180 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:39.753184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:39.753186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:39.753655 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:39.753947 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:39.754312 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 06:52:39.754551 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 06:52:39.755643 3008 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:39.843011 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 2820
I20260811 06:52:39.868286 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 2187
I20260811 06:52:39.869481 2282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:39.983307 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 2187
I20260811 06:52:40.015242 12868 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 06:52:40.361208 12868 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 06:52:40.361425 12868 mini_ranger.cc:66] Stopping Ranger...
I20260811 06:52:40.716223 12868 mini_ranger.cc:68] Stopped Ranger
2026-08-11 06:52:40.716 UTC [570] LOG: received smart shutdown request
2026-08-11 06:52:40.719 UTC [570] LOG: background worker "logical replication launcher" (PID 584) exited with exit code 1
2026-08-11 06:52:40.719 UTC [576] LOG: shutting down
2026-08-11 06:52:40.857 UTC [570] LOG: database system is shut down
2026-08-11T06:52:40Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53172 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:52:41 dist-test-slave-7lbf krb5kdc[3126](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:52:41 dist-test-slave-7lbf krb5kdc[3126](info): set up 2 sockets
Aug 11 06:52:41 dist-test-slave-7lbf krb5kdc[3126](info): commencing operation
krb5kdc: starting...
W20260811 06:52:42.208328 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.006s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:52:42 dist-test-slave-7lbf krb5kdc[3126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:52:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:52:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:52:42.481834 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:39163
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:37047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:39163,127.12.145.61:39075,127.12.145.60:33925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:42.834328 3146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:42.834610 3146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:42.834753 3146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:42.841886 3146 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:52:42.841984 3146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:42.842060 3146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:42.842136 3146 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:52:42.842193 3146 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:52:42.851828 3146 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:39163,127.12.145.61:39075,127.12.145.60:33925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:39163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:42.853055 3146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:42.854403 3146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:42.865660 3153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:42.865688 3156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:42.865926 3152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:42.866494 3146 server_base.cc:1034] running on GCE node
I20260811 06:52:42.867235 3146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:42.868520 3146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:42.869717 3146 hybrid_clock.cc:648] HybridClock initialized: now 1786431162869662 us; error 42 us; skew 500 ppm
I20260811 06:52:42.870072 3146 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:42 dist-test-slave-7lbf krb5kdc[3126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:42.873076 3146 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:52:42.874518 3146 webserver.cc:460] Webserver started at http://127.12.145.62:45919/ using document root <none> and password file <none>
I20260811 06:52:42.875173 3146 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:42.875293 3146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:42.875594 3146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:52:42.878701 3146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "e607068ff9b74c0682d4f881ad7070bb"
format_stamp: "Formatted at 2026-08-11 06:52:42 on dist-test-slave-7lbf"
server_key: "c3e4945e0f3657ed884dfde258d20f09"
server_key_iv: "888050207772c72dd28b2c94fde3e503"
server_key_version: "encryptionkey@0"
I20260811 06:52:42.879508 3146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "e607068ff9b74c0682d4f881ad7070bb"
format_stamp: "Formatted at 2026-08-11 06:52:42 on dist-test-slave-7lbf"
server_key: "c3e4945e0f3657ed884dfde258d20f09"
server_key_iv: "888050207772c72dd28b2c94fde3e503"
server_key_version: "encryptionkey@0"
I20260811 06:52:42.884639 3146 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 06:52:42.888154 3171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:42.889456 3146 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:52:42.889647 3146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "e607068ff9b74c0682d4f881ad7070bb"
format_stamp: "Formatted at 2026-08-11 06:52:42 on dist-test-slave-7lbf"
server_key: "c3e4945e0f3657ed884dfde258d20f09"
server_key_iv: "888050207772c72dd28b2c94fde3e503"
server_key_version: "encryptionkey@0"
I20260811 06:52:42.889832 3146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:42.910303 3146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:42.914148 3146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:42.914412 3146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:42.932710 3146 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:39163
I20260811 06:52:42.932739 3259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:39163 every 8 connection(s)
I20260811 06:52:42.934592 3146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:52:42.941341 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 3146
I20260811 06:52:42.941599 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:52:42.942402 12868 external_mini_cluster.cc:1428] Setting key e9cebe74251c7dc7a267d7c872f82523
I20260811 06:52:42.942795 3260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:42.951493 3260 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:52:42 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.61@KRBTEST.COM" created.
I20260811 06:52:42.976171 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:42.955298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:39163 (local address 127.0.0.1:38922)
0811 06:52:42.958067 (+ 2769us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:42.958109 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:42.959868 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:42.960833 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:42.960839 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:42.961391 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:42.961788 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:42.961811 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:42.963978 (+ 2167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:42.963982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:42.965063 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:42.965076 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:42.966339 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:42.966346 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:42.966473 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:42.967078 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:42.967106 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:42.969225 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:42.972286 (+ 3061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:42.972311 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:42.972322 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:42.972807 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:42.973184 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:42.973188 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:42.973192 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:42.973420 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:42.974176 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:42.974184 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:42.974434 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 06:52:42.974682 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 06:52:42.975224 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2504,"mutex_wait_us":98,"spinlock_wait_cycles":20736,"thread_start_us":2280,"threads_started":1}
I20260811 06:52:42.976204 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:42.955299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38922 (local address 127.12.145.62:39163)
0811 06:52:42.956703 (+ 1404us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:42.956719 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:42.958252 (+ 1533us) server_negotiation.cc:407] Connection header received
0811 06:52:42.960250 (+ 1998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:42.960258 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:42.960558 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:42.960793 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:42.962013 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:42.963822 (+ 1809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:42.965213 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:42.966114 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:42.966302 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:42.969444 (+ 3142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:42.969452 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:42.969463 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:42.969504 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:42.972155 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:42.972924 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:42.972930 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:42.972932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:42.973080 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:42.973556 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:42.973561 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:42.973564 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:42.974038 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:42.974194 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:42.974796 (+ 602us) server_negotiation.cc:299] Negotiation successful
0811 06:52:42.975073 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1159,"thread_start_us":894,"threads_started":1}
I20260811 06:52:42.978979 3260 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:52:42.979959 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:42.979551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33020)
0811 06:52:42.979715 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:42.979839 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 06:52:42.980194 3173 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
I20260811 06:52:42.981772 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:42.981391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33032)
0811 06:52:42.981591 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:42.981658 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 06:52:42.981967 3260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:39075: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab.
Entry for principal kudu/127.12.145.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab.
I20260811 06:52:43.002266 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.61:39075
--webserver_interface=127.12.145.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab
--principal=kudu/127.12.145.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:37047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:39163,127.12.145.61:39075,127.12.145.60:33925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:52:43.031270 3260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } attempt: 1
I20260811 06:52:43.032373 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.031924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33048)
0811 06:52:43.032118 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.032237 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 06:52:43.033406 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.033065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33062)
0811 06:52:43.033206 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.033270 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 06:52:43.033605 3260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:39075: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
I20260811 06:52:43.101843 3260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } attempt: 2
I20260811 06:52:43.102972 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.102491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33064)
0811 06:52:43.102731 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.102838 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 06:52:43.104014 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.103656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33074)
0811 06:52:43.103820 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.103889 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 06:52:43.104183 3260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:39075: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
I20260811 06:52:43.195407 3260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } attempt: 3
I20260811 06:52:43.196607 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.196150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33078)
0811 06:52:43.196367 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.196465 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 06:52:43.197722 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.197280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33082)
0811 06:52:43.197438 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.197564 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 06:52:43.197938 3260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:39075: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
W20260811 06:52:43.328838 3269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:43.329188 3269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:43.329332 3269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:43.336884 3269 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:52:43.337021 3269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:43.337105 3269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:43.337185 3269 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:52:43.337247 3269 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:52:43.341195 3260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } attempt: 4
I20260811 06:52:43.342478 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.341915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33094)
0811 06:52:43.342217 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.342331 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260811 06:52:43.343555 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.343191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33106)
0811 06:52:43.343348 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.343432 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 06:52:43.343750 3260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:39075: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39075: connect: Connection refused (error 111)
I20260811 06:52:43.347867 3269 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:39163,127.12.145.61:39075,127.12.145.60:33925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab
--principal=kudu/127.12.145.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.61:39075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.145.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:43.349288 3269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:43.350696 3269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:43.362529 3278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:43.362550 3279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:43.362756 3283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:43.363500 3269 server_base.cc:1034] running on GCE node
I20260811 06:52:43.364234 3269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:43.365753 3269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:43.366995 3269 hybrid_clock.cc:648] HybridClock initialized: now 1786431163366935 us; error 43 us; skew 500 ppm
I20260811 06:52:43.367364 3269 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:43 dist-test-slave-7lbf krb5kdc[3126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:43.373279 3269 init.cc:377] Logged in from keytab as kudu/127.12.145.61@KRBTEST.COM (short username kudu)
I20260811 06:52:43.374886 3269 webserver.cc:460] Webserver started at http://127.12.145.61:41229/ using document root <none> and password file <none>
I20260811 06:52:43.375605 3269 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:43.375730 3269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:43.376042 3269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:52:43.379195 3269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/data/instance:
uuid: "aff7f649ac5847c684bff9529bd7ad35"
format_stamp: "Formatted at 2026-08-11 06:52:43 on dist-test-slave-7lbf"
server_key: "907771d19079c72b84d3b3fcb7d9190b"
server_key_iv: "736a9d869464f3375c6631a5b7edb404"
server_key_version: "encryptionkey@0"
I20260811 06:52:43.380025 3269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/wal/instance:
uuid: "aff7f649ac5847c684bff9529bd7ad35"
format_stamp: "Formatted at 2026-08-11 06:52:43 on dist-test-slave-7lbf"
server_key: "907771d19079c72b84d3b3fcb7d9190b"
server_key_iv: "736a9d869464f3375c6631a5b7edb404"
server_key_version: "encryptionkey@0"
I20260811 06:52:43.385380 3269 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260811 06:52:43.388922 3295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:43.390303 3269 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:52:43.390480 3269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/wal
uuid: "aff7f649ac5847c684bff9529bd7ad35"
format_stamp: "Formatted at 2026-08-11 06:52:43 on dist-test-slave-7lbf"
server_key: "907771d19079c72b84d3b3fcb7d9190b"
server_key_iv: "736a9d869464f3375c6631a5b7edb404"
server_key_version: "encryptionkey@0"
I20260811 06:52:43.390699 3269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:43.414927 3269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:43.419081 3269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:43.419356 3269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:43.437038 3269 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.61:39075
I20260811 06:52:43.437085 3374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.61:39075 every 8 connection(s)
I20260811 06:52:43.438427 3269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
I20260811 06:52:43.441967 3375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:43.447409 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 3269
I20260811 06:52:43.447621 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-1/wal/instance
I20260811 06:52:43.448173 12868 external_mini_cluster.cc:1428] Setting key ba5d5bfbba53ed01aef999d69df33321
I20260811 06:52:43.448813 3375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:52:43 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:43.469267 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.451893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38926 (local address 127.12.145.62:39163)
0811 06:52:43.452107 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:43.452114 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:43.453406 (+ 1292us) server_negotiation.cc:407] Connection header received
0811 06:52:43.455319 (+ 1913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:43.455324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:43.455414 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:43.455525 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:43.456980 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.457899 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.459396 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.459814 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.459928 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.463582 (+ 3654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:43.463587 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:43.463591 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:43.463625 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:43.466205 (+ 2580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:43.466927 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:43.466933 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:43.466936 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:43.467060 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:43.467460 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:43.467473 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:43.467476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:43.467763 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:43.467902 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:43.468694 (+ 792us) server_negotiation.cc:299] Negotiation successful
0811 06:52:43.468942 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 06:52:43.470126 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.452409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:39163 (local address 127.0.0.1:38926)
0811 06:52:43.453212 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.453258 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:43.455033 (+ 1775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:43.455718 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:43.455726 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:43.456231 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:43.456793 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:43.456811 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.458033 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.458037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:43.459245 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:43.459257 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.460039 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.460048 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:43.460260 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.460966 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:43.461007 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:43.463354 (+ 2347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:43.466350 (+ 2996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:43.466359 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:43.466377 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:43.466808 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:43.467168 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:43.467173 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:43.467176 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:43.467351 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:43.467895 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:43.467903 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:43.468253 (+ 350us) client_negotiation.cc:769] Sending connection context
0811 06:52:43.468558 (+ 305us) client_negotiation.cc:240] Negotiation successful
0811 06:52:43.468958 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":333,"threads_started":1}
I20260811 06:52:43.471827 3375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.145.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.60@KRBTEST.COM" created.
Aug 11 06:52:43 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
I20260811 06:52:43.486249 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.472560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33122)
0811 06:52:43.472724 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.472742 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:43.472843 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:43.473959 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:43.473962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:43.474295 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:43.474445 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:43.474457 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.476050 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.476055 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:43.477251 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:43.477267 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.478130 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.478140 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:43.478346 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.478876 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:43.478897 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:43.481064 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:43.483934 (+ 2870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:43.483939 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:43.483943 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:43.484284 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:43.484629 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:43.484633 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:43.484635 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:43.484766 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:43.485326 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:43.485331 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:43.485457 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 06:52:43.485598 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 06:52:43.485877 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 06:52:43.486349 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.472835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33122 (local address 127.12.145.61:39075)
0811 06:52:43.473563 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:43.473569 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:43.473596 (+ 27us) server_negotiation.cc:407] Connection header received
0811 06:52:43.473639 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:43.473645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:43.473817 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:43.473935 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:43.474626 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.475901 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.477403 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.477985 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.478080 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.481245 (+ 3165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:43.481256 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:43.481269 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:43.481300 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:43.483819 (+ 2519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:43.484407 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:43.484414 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:43.484416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:43.484522 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:43.484859 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:43.484863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:43.484867 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:43.485193 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:43.485386 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:43.485737 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 06:52:43.485981 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":508,"thread_start_us":373,"threads_started":1}
I20260811 06:52:43.488770 3375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:52:43.489861 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.489319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:41930)
0811 06:52:43.489555 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.489682 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 06:52:43.490109 3296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
I20260811 06:52:43.491619 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.491251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:41938)
0811 06:52:43.491403 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.491505 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 06:52:43.491859 3375 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:33925: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab.
Entry for principal kudu/127.12.145.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab.
I20260811 06:52:43.508126 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.60:33925
--webserver_interface=127.12.145.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab
--principal=kudu/127.12.145.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:37047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:39163,127.12.145.61:39075,127.12.145.60:33925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:52:43.541231 3375 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } attempt: 1
I20260811 06:52:43.542618 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.542061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:41946)
0811 06:52:43.542280 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.542414 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 06:52:43.543655 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.543271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:41960)
0811 06:52:43.543433 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.543525 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 06:52:43.543853 3375 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:33925: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
I20260811 06:52:43.612100 3375 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } attempt: 2
I20260811 06:52:43.613426 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.612862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:41966)
0811 06:52:43.613106 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.613227 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 06:52:43.614612 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.614196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:41970)
0811 06:52:43.614364 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.614458 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 06:52:43.614863 3375 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:33925: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
I20260811 06:52:43.643021 3260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } attempt: 5
Aug 11 06:52:43 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
I20260811 06:52:43.657411 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.643844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33134)
0811 06:52:43.644052 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.644078 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:43.644196 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:43.644567 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:43.644570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:43.644977 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:43.645183 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:43.645193 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.646646 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.646651 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:43.647578 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:43.647592 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.648537 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.648542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:43.648701 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.649333 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:43.649352 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:43.651451 (+ 2099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:43.655059 (+ 3608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:43.655063 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:43.655065 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:43.655433 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:43.655870 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:43.655873 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:43.655876 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:43.656010 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:43.656667 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:43.656671 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:43.656810 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 06:52:43.656964 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 06:52:43.657164 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 06:52:43.657721 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.643910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33134 (local address 127.12.145.61:39075)
0811 06:52:43.644142 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:43.644148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:43.644173 (+ 25us) server_negotiation.cc:407] Connection header received
0811 06:52:43.644322 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:43.644328 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:43.644411 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:43.644544 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:43.645361 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.646488 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.647728 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.648386 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.648529 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.651662 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:43.651668 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:43.651673 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:43.651713 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:43.654917 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:43.655556 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:43.655561 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:43.655565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:43.655730 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:43.656116 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:43.656121 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:43.656125 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:43.656530 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:43.656691 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:43.657109 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 06:52:43.657341 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 06:52:43.658660 3260 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:52:43.659642 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.659305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:41974)
0811 06:52:43.659445 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.659517 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 06:52:43.660470 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.660201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:41976)
0811 06:52:43.660318 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.660381 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 06:52:43.660650 3260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:33925: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
I20260811 06:52:43.706107 3375 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } attempt: 3
I20260811 06:52:43.707491 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.706857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:41984)
0811 06:52:43.707116 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.707248 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 06:52:43.708725 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.708180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:41998)
0811 06:52:43.708442 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.708560 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
W20260811 06:52:43.708954 3375 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:33925: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
I20260811 06:52:43.711859 3260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } attempt: 1
I20260811 06:52:43.712860 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.712433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42004)
0811 06:52:43.712599 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.712681 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 06:52:43.713958 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.713482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42006)
0811 06:52:43.713729 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.713840 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260811 06:52:43.714226 3260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:33925: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
I20260811 06:52:43.782451 3260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } attempt: 2
I20260811 06:52:43.783670 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.783167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42012)
0811 06:52:43.783401 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.783506 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 06:52:43.784693 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.784348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42016)
0811 06:52:43.784500 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.784585 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 06:52:43.784917 3260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:33925: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
W20260811 06:52:43.843811 3385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:43.844125 3385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:43.844266 3385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:43.851650 3385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:52:43.851796 3385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:43.851872 3385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:43.851964 3385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:52:43.852023 3385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:52:43.852161 3375 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } attempt: 4
I20260811 06:52:43.853415 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.852852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42024)
0811 06:52:43.853098 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.853210 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 06:52:43.854470 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.854093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42028)
0811 06:52:43.854240 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.854335 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 06:52:43.854700 3375 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:33925: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
I20260811 06:52:43.862694 3385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:39163,127.12.145.61:39075,127.12.145.60:33925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab
--principal=kudu/127.12.145.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.60:33925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.145.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:43.863981 3385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:43.865271 3385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:43.876662 3397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:43.876626 3401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:43.876582 3398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:43.877645 3385 server_base.cc:1034] running on GCE node
I20260811 06:52:43.878536 3385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:43.879943 3385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:43.881173 3385 hybrid_clock.cc:648] HybridClock initialized: now 1786431163881120 us; error 49 us; skew 500 ppm
I20260811 06:52:43.881568 3385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:43 dist-test-slave-7lbf krb5kdc[3126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:43.884606 3385 init.cc:377] Logged in from keytab as kudu/127.12.145.60@KRBTEST.COM (short username kudu)
I20260811 06:52:43.886207 3385 webserver.cc:460] Webserver started at http://127.12.145.60:36415/ using document root <none> and password file <none>
I20260811 06:52:43.886894 3385 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:43.887020 3385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:43.887317 3385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:52:43.890471 3385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/data/instance:
uuid: "228ffd74de7749928939fc8f3bde1d2e"
format_stamp: "Formatted at 2026-08-11 06:52:43 on dist-test-slave-7lbf"
server_key: "77936dbe9a43fe6047f63143274e423f"
server_key_iv: "e74b93d79d0ff35af5157bb2dc216ccf"
server_key_version: "encryptionkey@0"
I20260811 06:52:43.891109 3260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } attempt: 3
I20260811 06:52:43.891314 3385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/wal/instance:
uuid: "228ffd74de7749928939fc8f3bde1d2e"
format_stamp: "Formatted at 2026-08-11 06:52:43 on dist-test-slave-7lbf"
server_key: "77936dbe9a43fe6047f63143274e423f"
server_key_iv: "e74b93d79d0ff35af5157bb2dc216ccf"
server_key_version: "encryptionkey@0"
I20260811 06:52:43.892108 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.891650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42030)
0811 06:52:43.891861 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.891953 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 06:52:43.893062 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.892733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42038)
0811 06:52:43.892887 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.892960 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 06:52:43.893256 3260 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:33925: Network error: Client connection negotiation failed: client connection to 127.12.145.60:33925: connect: Connection refused (error 111)
I20260811 06:52:43.896771 3385 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:52:43.900269 3410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:43.901650 3385 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:52:43.901808 3385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/wal
uuid: "228ffd74de7749928939fc8f3bde1d2e"
format_stamp: "Formatted at 2026-08-11 06:52:43 on dist-test-slave-7lbf"
server_key: "77936dbe9a43fe6047f63143274e423f"
server_key_iv: "e74b93d79d0ff35af5157bb2dc216ccf"
server_key_version: "encryptionkey@0"
I20260811 06:52:43.902001 3385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:43.937220 3385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:43.941419 3385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:43.941715 3385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:43.961148 3385 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.60:33925
I20260811 06:52:43.961202 3484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.60:33925 every 8 connection(s)
I20260811 06:52:43.962608 3385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
I20260811 06:52:43.964093 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 3385
I20260811 06:52:43.964294 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786430925511755-12868-0/minicluster-data/master-2/wal/instance
I20260811 06:52:43.964972 12868 external_mini_cluster.cc:1428] Setting key 5db94794b069d44a6ddc1b690d646815
I20260811 06:52:43.967180 3487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:43.974385 3487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:52:43 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
Aug 11 06:52:43 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:43.987406 3498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.966942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42054 (local address 127.12.145.60:33925)
0811 06:52:43.967726 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:43.967737 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:43.967778 (+ 41us) server_negotiation.cc:407] Connection header received
0811 06:52:43.969378 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:43.969399 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:43.969813 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:43.970189 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:43.971725 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.973057 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.974436 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.975160 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.975350 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.979802 (+ 4452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:43.979809 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:43.979819 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:43.979852 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:43.983229 (+ 3377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:43.983966 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:43.983973 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:43.983982 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:43.984209 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:43.984547 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:43.984552 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:43.984555 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:43.985159 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:43.985376 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:43.985908 (+ 532us) server_negotiation.cc:299] Negotiation successful
0811 06:52:43.986323 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":347,"threads_started":1}
I20260811 06:52:43.992803 3499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.976812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:39163 (local address 127.0.0.1:38942)
0811 06:52:43.977579 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.977619 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:43.977762 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:43.978495 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:43.978500 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:43.979078 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:43.979341 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:43.979350 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.980510 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.980515 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:43.982187 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:43.982204 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.982927 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.982935 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:43.983129 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.983721 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:43.983738 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:43.986122 (+ 2384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:43.990154 (+ 4032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:43.990165 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:43.990172 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:43.990771 (+ 599us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:43.991154 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:43.991159 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:43.991162 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:43.991328 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:43.991943 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:43.991948 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:43.992097 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 06:52:43.992227 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 06:52:43.992434 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":364,"threads_started":1}
I20260811 06:52:43.993314 3500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.976907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38942 (local address 127.12.145.62:39163)
0811 06:52:43.978151 (+ 1244us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:43.978155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:43.978171 (+ 16us) server_negotiation.cc:407] Connection header received
0811 06:52:43.978219 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:43.978223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:43.978293 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:43.978418 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:43.979504 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.980361 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.982333 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.982733 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.982833 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.986297 (+ 3464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:43.986303 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:43.986306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:43.986338 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:43.990015 (+ 3677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:43.990903 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:43.990907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:43.990909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:43.991042 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:43.991458 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:43.991463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:43.991466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:43.991835 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:43.991995 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:43.992381 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 06:52:43.992596 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1148,"thread_start_us":1039,"threads_started":1}
I20260811 06:52:43.994693 3487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:52:43 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
Aug 11 06:52:43 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
I20260811 06:52:44.005168 3501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.990253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38958 (local address 127.12.145.62:39163)
0811 06:52:43.990868 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:43.990873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:43.990901 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:52:43.990947 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:43.990954 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:43.991010 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:43.991087 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:43.992603 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.993718 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.995306 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.995854 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.995965 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.999904 (+ 3939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:43.999908 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:43.999912 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:43.999940 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:44.002607 (+ 2667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.003217 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.003221 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.003223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.003336 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.003719 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.003724 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.003727 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.004002 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:44.004238 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:44.004512 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 06:52:44.004718 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":267,"threads_started":1}
I20260811 06:52:44.006816 3499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.995287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39075 (local address 127.0.0.1:33142)
0811 06:52:43.995444 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:43.995462 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:43.995548 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:43.995916 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:43.995920 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:43.996268 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:43.996401 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:43.996409 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.997329 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.997334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:43.998211 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:43.998223 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.998876 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.998882 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:43.999067 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:43.999541 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:43.999555 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:44.001574 (+ 2019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:44.004377 (+ 2803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:44.004382 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:44.004386 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:44.004795 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:44.005226 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:44.005230 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:44.005232 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:44.005389 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:44.005978 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:44.005982 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:44.006116 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 06:52:44.006260 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 06:52:44.006514 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 06:52:44.006871 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:43.995477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33142 (local address 127.12.145.61:39075)
0811 06:52:43.995663 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:43.995668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:43.995681 (+ 13us) server_negotiation.cc:407] Connection header received
0811 06:52:43.995727 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:43.995730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:43.995784 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:43.995880 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:43.996539 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.997192 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.998343 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:43.998737 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:43.998850 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.001746 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:44.001751 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:44.001754 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:44.001785 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:44.004256 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.004953 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.004958 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.004961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.005118 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.005485 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.005490 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.005494 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.005871 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:44.006037 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:44.006377 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 06:52:44.006541 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 06:52:44.008069 3487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:52:44 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
Aug 11 06:52:44 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
I20260811 06:52:44.020813 3499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:44.008700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42062)
0811 06:52:44.008889 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:44.008908 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:44.009000 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:44.009260 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:44.009265 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:44.009714 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:44.009888 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:44.009899 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.011162 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.011166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:44.012295 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:44.012308 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.013143 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.013147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:44.013273 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.013786 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:44.013801 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:44.015715 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:44.018601 (+ 2886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:44.018606 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:44.018610 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:44.018943 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:44.019268 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:44.019273 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:44.019277 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:44.019397 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:44.019866 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:44.019871 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:44.020002 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 06:52:44.020132 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 06:52:44.020409 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 06:52:44.021283 3498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:44.008852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42062 (local address 127.12.145.60:33925)
0811 06:52:44.008993 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:44.008999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:44.009014 (+ 15us) server_negotiation.cc:407] Connection header received
0811 06:52:44.009095 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:44.009099 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:44.009147 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:44.009211 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:44.010026 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.011026 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.012427 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.012992 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.013114 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.015874 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:44.015881 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:44.015886 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:44.015919 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:44.018489 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.019046 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.019051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.019055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.019170 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.019493 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.019498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.019502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.019756 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:44.019882 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:44.020227 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 06:52:44.020584 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":126,"server-negotiator.queue_time_us":38}
I20260811 06:52:44.021338 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:44.007228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33144 (local address 127.12.145.61:39075)
0811 06:52:44.007407 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:44.007413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:44.007428 (+ 15us) server_negotiation.cc:407] Connection header received
0811 06:52:44.007475 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:44.007479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:44.007529 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:44.007605 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:44.009005 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.010063 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.011563 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.012189 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.012313 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.016511 (+ 4198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:44.016515 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:44.016518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:44.016547 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:44.018984 (+ 2437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.019579 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.019585 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.019588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.019719 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.020066 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.020069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.020071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.020311 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:44.020579 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:44.020837 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 06:52:44.021055 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 06:52:44.026218 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:52:44.027040 3487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e: Bootstrap starting.
I20260811 06:52:44.031235 3487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:44.032621 3487 log.cc:824] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:44.042884 3487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e: No bootstrap required, opened a new log
I20260811 06:52:44.051435 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:44.031838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33150 (local address 127.12.145.61:39075)
0811 06:52:44.032000 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:44.032007 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:44.032631 (+ 624us) server_negotiation.cc:407] Connection header received
0811 06:52:44.033170 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:44.033177 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:44.033264 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:44.033351 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:44.035851 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.037059 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.039454 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.040079 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.040151 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.044237 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:44.044244 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:44.044249 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:44.044289 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:44.047718 (+ 3429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.048766 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.048772 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.048775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.048936 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.049484 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.049489 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.049492 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.049895 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:44.050128 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:44.050847 (+ 719us) server_negotiation.cc:299] Negotiation successful
0811 06:52:44.051084 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 06:52:44.056560 3498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:44.032663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42078 (local address 127.12.145.60:33925)
0811 06:52:44.032895 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:44.032900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:44.040259 (+ 7359us) server_negotiation.cc:407] Connection header received
0811 06:52:44.040322 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:44.040325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:44.040384 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:44.040472 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:44.042693 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.043844 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.045890 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.046615 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.046715 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.050425 (+ 3710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:44.050431 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:44.050435 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:44.050473 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:44.053591 (+ 3118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.054405 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.054415 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.054419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.054589 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.055012 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.055017 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.055024 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.055388 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:44.055622 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:44.055962 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 06:52:44.056193 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 06:52:44.056761 3501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:44.031818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38964 (local address 127.12.145.62:39163)
0811 06:52:44.032035 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:44.032042 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:44.039169 (+ 7127us) server_negotiation.cc:407] Connection header received
0811 06:52:44.039652 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:44.039658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:44.039747 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:44.039825 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:44.042376 (+ 2551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.043355 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.045553 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.046175 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.046271 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.049800 (+ 3529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:44.049807 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:44.049812 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:44.049854 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:44.054004 (+ 4150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.054750 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.054755 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.054759 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.054879 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.055340 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.055346 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.055350 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.055691 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:44.055948 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:44.056233 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 06:52:44.056461 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:52:44.056532 3487 raft_consensus.cc:348] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } }
I20260811 06:52:44.056995 3487 raft_consensus.cc:374] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:44.057128 3487 raft_consensus.cc:729] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 228ffd74de7749928939fc8f3bde1d2e, State: Initialized, Role: FOLLOWER
I20260811 06:52:44.057961 3487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } }
I20260811 06:52:44.058907 3512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } } }
I20260811 06:52:44.059204 3512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:52:44.059968 3487 sys_catalog.cc:564] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:52:44.070446 3260 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } attempt: 4
W20260811 06:52:44.072474 3531 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:52:44.072598 3531 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:52:44.066593 3385 master_runner.cc:186] Error getting master registration for 127.12.145.62:39163: OK, instance_id { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" instance_seqno: 1786431162926709 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 06:52:44.076951 3385 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 06:52:44 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
I20260811 06:52:44.087615 3498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:44.071654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42094 (local address 127.12.145.60:33925)
0811 06:52:44.071835 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:44.071840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:44.071857 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:52:44.071917 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:44.071925 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:44.072015 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:44.072119 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:44.073189 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.074427 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.076191 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.076982 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.077111 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.081001 (+ 3890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:44.081006 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:44.081010 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:44.081041 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:44.084625 (+ 3584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.085491 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.085504 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.085507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.085720 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.086176 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.086180 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.086182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.086550 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:44.086663 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:44.087152 (+ 489us) server_negotiation.cc:299] Negotiation successful
0811 06:52:44.087336 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 06:52:44.087746 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:44.070992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42094)
0811 06:52:44.071329 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:44.071349 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:44.071452 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:44.072323 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:44.072329 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:44.072837 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:44.073023 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:44.073035 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.074604 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.074610 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:44.076043 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:44.076059 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.077311 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.077318 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:44.077506 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.078139 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:44.078163 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:44.080823 (+ 2660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:44.084767 (+ 3944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:44.084774 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:44.084779 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:44.085350 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:44.085851 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:44.085857 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:44.085860 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:44.086056 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:44.086688 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:44.086694 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:44.086887 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 06:52:44.087060 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 06:52:44.087372 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217}
I20260811 06:52:44.092935 3260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb: Bootstrap starting.
I20260811 06:52:44.096428 3260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:44.097535 3260 log.cc:824] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:44.100356 3260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb: No bootstrap required, opened a new log
I20260811 06:52:44.108161 3260 raft_consensus.cc:348] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } }
I20260811 06:52:44.108489 3260 raft_consensus.cc:374] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:44.108596 3260 raft_consensus.cc:729] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e607068ff9b74c0682d4f881ad7070bb, State: Initialized, Role: FOLLOWER
I20260811 06:52:44.109198 3260 consensus_queue.cc:260] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } }
I20260811 06:52:44.110136 3535 sys_catalog.cc:455] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } } }
I20260811 06:52:44.110543 3535 sys_catalog.cc:458] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:52:44.111418 3260 sys_catalog.cc:564] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [sys.catalog]: configured and running, proceeding with master startup.
W20260811 06:52:44.122519 3551 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:52:44.122754 3551 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:52:44.121114 3146 master_runner.cc:186] Error getting master registration for 127.12.145.61:39075: OK, instance_id { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" instance_seqno: 1786431163432025 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 06:52:44.132254 3146 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 06:52:44.153920 3375 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } attempt: 5
Aug 11 06:52:44 dist-test-slave-7lbf krb5kdc[3126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
W20260811 06:52:44.167189 3183 tablet.cc:2369] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:52:44.171413 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:44.154567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:33925 (local address 127.0.0.1:42110)
0811 06:52:44.154826 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:44.154846 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:44.154979 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:44.155346 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:44.155351 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:44.155892 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:44.156117 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:44.156131 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.157568 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.157573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:44.159067 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:44.159084 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.160121 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.160128 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:44.160346 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.161028 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:44.161055 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:44.163932 (+ 2877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:44.168303 (+ 4371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:44.168308 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:44.168312 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:44.168851 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:44.169316 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:44.169322 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:44.169326 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:44.169494 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:44.170342 (+ 848us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:44.170347 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:44.170513 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 06:52:44.170691 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 06:52:44.171008 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260811 06:52:44.172508 3498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:44.154634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42110 (local address 127.12.145.60:33925)
0811 06:52:44.154829 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:44.154836 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:44.154908 (+ 72us) server_negotiation.cc:407] Connection header received
0811 06:52:44.155111 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:44.155117 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:44.155198 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:44.155307 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:44.156273 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.157393 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.159238 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:44.159958 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:44.160095 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:44.164144 (+ 4049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:44.164151 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:44.164157 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:44.164197 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:44.168130 (+ 3933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.169018 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.169024 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.169027 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.169178 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:44.169667 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:44.169675 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:44.169679 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:44.170119 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:44.170271 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:44.171842 (+ 1571us) server_negotiation.cc:299] Negotiation successful
0811 06:52:44.172121 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 06:52:44.178767 3375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35: Bootstrap starting.
I20260811 06:52:44.182873 3375 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:44.184238 3375 log.cc:824] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:44.191354 3375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35: No bootstrap required, opened a new log
W20260811 06:52:44.193941 3416 tablet.cc:2369] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:52:44.202801 3375 raft_consensus.cc:348] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } }
I20260811 06:52:44.203270 3375 raft_consensus.cc:374] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:44.203390 3375 raft_consensus.cc:729] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff7f649ac5847c684bff9529bd7ad35, State: Initialized, Role: FOLLOWER
I20260811 06:52:44.204136 3375 consensus_queue.cc:260] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } }
I20260811 06:52:44.207625 3375 sys_catalog.cc:564] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:52:44.205196 3556 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } } }
I20260811 06:52:44.209255 3556 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:52:44.232890 3269 master_runner.cc:263] No leader master found from master aff7f649ac5847c684bff9529bd7ad35
I20260811 06:52:44.233067 3269 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 06:52:44.236354 3569 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:52:44.236516 3569 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:52:44.345710 3535 raft_consensus.cc:482] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:52:44.346096 3535 raft_consensus.cc:504] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } }
I20260811 06:52:44.347954 3535 leader_election.cc:288] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff7f649ac5847c684bff9529bd7ad35 (127.12.145.61:39075), 228ffd74de7749928939fc8f3bde1d2e (127.12.145.60:33925)
I20260811 06:52:44.349404 3455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e607068ff9b74c0682d4f881ad7070bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "228ffd74de7749928939fc8f3bde1d2e" is_pre_election: true
I20260811 06:52:44.350103 3455 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e607068ff9b74c0682d4f881ad7070bb in term 0.
I20260811 06:52:44.351449 3335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e607068ff9b74c0682d4f881ad7070bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff7f649ac5847c684bff9529bd7ad35" is_pre_election: true
I20260811 06:52:44.352116 3335 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e607068ff9b74c0682d4f881ad7070bb in term 0.
I20260811 06:52:44.352821 3173 leader_election.cc:302] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228ffd74de7749928939fc8f3bde1d2e, e607068ff9b74c0682d4f881ad7070bb; no voters:
I20260811 06:52:44.353945 3535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:52:44.354130 3535 raft_consensus.cc:482] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:52:44.354228 3535 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:44.362844 3535 raft_consensus.cc:504] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } }
I20260811 06:52:44.366179 3335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e607068ff9b74c0682d4f881ad7070bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff7f649ac5847c684bff9529bd7ad35"
I20260811 06:52:44.366431 3335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:44.370108 3335 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e607068ff9b74c0682d4f881ad7070bb in term 1.
I20260811 06:52:44.370718 3173 leader_election.cc:302] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff7f649ac5847c684bff9529bd7ad35, e607068ff9b74c0682d4f881ad7070bb; no voters:
I20260811 06:52:44.372740 3535 leader_election.cc:288] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [CANDIDATE]: Term 1 election: Requested vote from peers aff7f649ac5847c684bff9529bd7ad35 (127.12.145.61:39075), 228ffd74de7749928939fc8f3bde1d2e (127.12.145.60:33925)
I20260811 06:52:44.373342 3535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:52:44.373821 3535 raft_consensus.cc:686] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [term 1 LEADER]: Becoming Leader. State: Replica: e607068ff9b74c0682d4f881ad7070bb, State: Running, Role: LEADER
I20260811 06:52:44.374725 3535 consensus_queue.cc:237] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } }
I20260811 06:52:44.390108 3573 sys_catalog.cc:455] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader e607068ff9b74c0682d4f881ad7070bb. Latest consensus state: current_term: 1 leader_uuid: "e607068ff9b74c0682d4f881ad7070bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } } }
I20260811 06:52:44.390585 3573 sys_catalog.cc:458] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:44.391621 3455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e607068ff9b74c0682d4f881ad7070bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "228ffd74de7749928939fc8f3bde1d2e"
I20260811 06:52:44.391866 3455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:44.395632 3455 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e607068ff9b74c0682d4f881ad7070bb in term 1.
I20260811 06:52:44.397019 3575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:52:44.399276 3575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:52:44.419871 3455 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [term 1 FOLLOWER]: Refusing update from remote peer e607068ff9b74c0682d4f881ad7070bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:52:44.421159 3335 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [term 1 FOLLOWER]: Refusing update from remote peer e607068ff9b74c0682d4f881ad7070bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 06:52:44.422029 3301 tablet.cc:2369] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:52:44.422380 3573 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:52:44.423826 3573 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:52:44.462704 3512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e607068ff9b74c0682d4f881ad7070bb. Latest consensus state: current_term: 1 leader_uuid: "e607068ff9b74c0682d4f881ad7070bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } } }
I20260811 06:52:44.463105 3512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:52:44.471830 3556 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e607068ff9b74c0682d4f881ad7070bb. Latest consensus state: current_term: 1 leader_uuid: "e607068ff9b74c0682d4f881ad7070bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } } }
I20260811 06:52:44.472129 3556 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:52:44.475360 3576 mvcc.cc:205] Tried to move back new op lower bound from 7317222049436250112 to 7317222049292972032. Current Snapshot: MvccSnapshot[applied={T|T < 7317222049436250112}]
I20260811 06:52:44.479404 3573 sys_catalog.cc:455] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e607068ff9b74c0682d4f881ad7070bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } } }
I20260811 06:52:44.479681 3573 sys_catalog.cc:458] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:44.480059 3535 sys_catalog.cc:455] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e607068ff9b74c0682d4f881ad7070bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } } }
I20260811 06:52:44.480329 3535 sys_catalog.cc:458] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:44.481340 3577 mvcc.cc:205] Tried to move back new op lower bound from 7317222049436250112 to 7317222049292972032. Current Snapshot: MvccSnapshot[applied={T|T < 7317222049436250112}]
I20260811 06:52:44.481977 3512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e607068ff9b74c0682d4f881ad7070bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } } }
I20260811 06:52:44.482234 3512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:52:44.483428 3556 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e607068ff9b74c0682d4f881ad7070bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e607068ff9b74c0682d4f881ad7070bb" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39163 } } peers { permanent_uuid: "aff7f649ac5847c684bff9529bd7ad35" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39075 } } peers { permanent_uuid: "228ffd74de7749928939fc8f3bde1d2e" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 33925 } } }
I20260811 06:52:44.483688 3556 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:52:44.484714 3575 catalog_manager.cc:1347] Generated new cluster ID: c24f56ea9b05481b955747630e20299d
I20260811 06:52:44.484829 3575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:52:44.529973 3575 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:52:44.531400 3575 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:52:44.545224 3575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e607068ff9b74c0682d4f881ad7070bb: Generated new TSK 0
I20260811 06:52:44.547451 3575 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:52:45.074606 3531 catalog_manager.cc:1259] Loaded cluster ID: c24f56ea9b05481b955747630e20299d
I20260811 06:52:45.074717 3531 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e: loading cluster ID for follower catalog manager: success
I20260811 06:52:45.077441 3531 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e: acquiring CA information for follower catalog manager: success
I20260811 06:52:45.079234 3531 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 228ffd74de7749928939fc8f3bde1d2e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 06:52:45.238709 3569 catalog_manager.cc:1259] Loaded cluster ID: c24f56ea9b05481b955747630e20299d
I20260811 06:52:45.238848 3569 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35: loading cluster ID for follower catalog manager: success
I20260811 06:52:45.241410 3569 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35: acquiring CA information for follower catalog manager: success
I20260811 06:52:45.243278 3569 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aff7f649ac5847c684bff9529bd7ad35: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 06:52:45.628222 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 3146
I20260811 06:52:45.629257 3252 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:45.737285 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 3146
W20260811 06:52:45.764472 3296 connection.cc:535] server connection from 127.0.0.1:33134 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 06:52:45.764899 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 3269
I20260811 06:52:45.765971 3370 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:45.869881 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 3269
I20260811 06:52:45.892563 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 3385
I20260811 06:52:45.893715 3480 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:45.999482 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 3385
2026-08-11T06:52:46Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5042 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:52:46 dist-test-slave-7lbf krb5kdc[3600](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:52:46 dist-test-slave-7lbf krb5kdc[3600](info): set up 2 sockets
Aug 11 06:52:46 dist-test-slave-7lbf krb5kdc[3600](info): commencing operation
krb5kdc: starting...
W20260811 06:52:47.250497 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:52:47 dist-test-slave-7lbf krb5kdc[3600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:52:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:52:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:52:47.508490 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:36719
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:40093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:36719
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:47.845259 3625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:47.845573 3625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:47.845709 3625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:47.852773 3625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:52:47.852892 3625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:47.852973 3625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:47.853050 3625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:52:47.853119 3625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:52:47.862771 3625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:40093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:36719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:36719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:47.864042 3625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:47.865319 3625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:47.876686 3632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:47.876765 3635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:47.876727 3633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:47.877869 3625 server_base.cc:1034] running on GCE node
I20260811 06:52:47.878640 3625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:47.880034 3625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:47.881281 3625 hybrid_clock.cc:648] HybridClock initialized: now 1786431167881213 us; error 50 us; skew 500 ppm
I20260811 06:52:47.881705 3625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:47 dist-test-slave-7lbf krb5kdc[3600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431167, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:47.884672 3625 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:52:47.886264 3625 webserver.cc:460] Webserver started at http://127.12.145.62:45347/ using document root <none> and password file <none>
I20260811 06:52:47.886933 3625 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:47.887064 3625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:47.887351 3625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:52:47.890311 3625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "f26423509a1649b4b489bc68fca28469"
format_stamp: "Formatted at 2026-08-11 06:52:47 on dist-test-slave-7lbf"
server_key: "ca837e803012453fa9f9a9b8e6b17e22"
server_key_iv: "36c1730bb9ea61b5f3a8277327995dca"
server_key_version: "encryptionkey@0"
I20260811 06:52:47.891106 3625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "f26423509a1649b4b489bc68fca28469"
format_stamp: "Formatted at 2026-08-11 06:52:47 on dist-test-slave-7lbf"
server_key: "ca837e803012453fa9f9a9b8e6b17e22"
server_key_iv: "36c1730bb9ea61b5f3a8277327995dca"
server_key_version: "encryptionkey@0"
I20260811 06:52:47.896231 3625 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:52:47.899571 3642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:47.901000 3625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:52:47.901172 3625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "f26423509a1649b4b489bc68fca28469"
format_stamp: "Formatted at 2026-08-11 06:52:47 on dist-test-slave-7lbf"
server_key: "ca837e803012453fa9f9a9b8e6b17e22"
server_key_iv: "36c1730bb9ea61b5f3a8277327995dca"
server_key_version: "encryptionkey@0"
I20260811 06:52:47.901350 3625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:47.919653 3625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:47.923545 3625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:47.923800 3625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:47.941690 3625 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:36719
I20260811 06:52:47.941747 3728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:36719 every 8 connection(s)
I20260811 06:52:47.943430 3625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:52:47.947932 3729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:47.951838 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 3625
I20260811 06:52:47.952031 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:52:47.952684 12868 external_mini_cluster.cc:1428] Setting key e0a954aa1a386f1583d38392cc9b5408
I20260811 06:52:47.960625 3729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469: Bootstrap starting.
I20260811 06:52:47.964309 3729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:47.965646 3729 log.cc:824] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469: Log is configured to *not* fsync() on all Append() calls
Aug 11 06:52:47 dist-test-slave-7lbf krb5kdc[3600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:47.968441 3729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469: No bootstrap required, opened a new log
I20260811 06:52:47.975854 3732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:47.954372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57650 (local address 127.12.145.62:36719)
0811 06:52:47.955130 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:47.955141 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:47.955183 (+ 42us) server_negotiation.cc:407] Connection header received
0811 06:52:47.956750 (+ 1567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:47.956772 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:47.957165 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:47.957480 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:47.959300 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:47.960555 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:47.962456 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:47.963117 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:47.963244 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:47.967905 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:47.967913 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:47.967926 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:47.967963 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:47.971516 (+ 3553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:47.972412 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:47.972420 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:47.972429 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:47.972664 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:47.973125 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:47.973128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:47.973131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:47.973747 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:47.973993 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:47.974478 (+ 485us) server_negotiation.cc:299] Negotiation successful
0811 06:52:47.974793 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":332,"threads_started":1}
I20260811 06:52:47.977912 3729 raft_consensus.cc:348] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26423509a1649b4b489bc68fca28469" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36719 } }
I20260811 06:52:47.978245 3729 raft_consensus.cc:374] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:47.978345 3729 raft_consensus.cc:729] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26423509a1649b4b489bc68fca28469, State: Initialized, Role: FOLLOWER
I20260811 06:52:47.978922 3729 consensus_queue.cc:260] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26423509a1649b4b489bc68fca28469" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36719 } }
I20260811 06:52:47.979162 3729 raft_consensus.cc:388] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:52:47.979287 3729 raft_consensus.cc:482] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:52:47.979455 3729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:47.979547 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:52:47.982442 3729 raft_consensus.cc:504] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26423509a1649b4b489bc68fca28469" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36719 } }
I20260811 06:52:47.982890 3729 leader_election.cc:302] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f26423509a1649b4b489bc68fca28469; no voters:
I20260811 06:52:47.983454 3729 leader_election.cc:288] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:52:47.983558 3735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:52:47.984169 3735 raft_consensus.cc:686] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [term 1 LEADER]: Becoming Leader. State: Replica: f26423509a1649b4b489bc68fca28469, State: Running, Role: LEADER
I20260811 06:52:47.984678 3735 consensus_queue.cc:237] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26423509a1649b4b489bc68fca28469" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36719 } }
I20260811 06:52:47.985323 3729 sys_catalog.cc:564] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:52:47.987427 3736 sys_catalog.cc:455] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f26423509a1649b4b489bc68fca28469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26423509a1649b4b489bc68fca28469" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36719 } } }
I20260811 06:52:47.987713 3736 sys_catalog.cc:458] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:47.988113 3737 sys_catalog.cc:455] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f26423509a1649b4b489bc68fca28469. Latest consensus state: current_term: 1 leader_uuid: "f26423509a1649b4b489bc68fca28469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26423509a1649b4b489bc68fca28469" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 36719 } } }
I20260811 06:52:47.988425 3737 sys_catalog.cc:458] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:47.989449 3747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:52:47.993764 3747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:52:48.000955 3747 catalog_manager.cc:1347] Generated new cluster ID: d2bc377d337945109d0ca506e1264032
I20260811 06:52:48.001060 3747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:52:48.018996 3747 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:52:48.020219 3747 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:52:48.031136 3747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f26423509a1649b4b489bc68fca28469: Generated new TSK 0
I20260811 06:52:48.031925 3747 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:52:48.040357 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 3625
I20260811 06:52:48.041568 3723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:48.132064 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 3625
2026-08-11T06:52:48Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2127 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:52:48 dist-test-slave-7lbf krb5kdc[3771](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:52:48 dist-test-slave-7lbf krb5kdc[3771](info): set up 2 sockets
Aug 11 06:52:48 dist-test-slave-7lbf krb5kdc[3771](info): commencing operation
krb5kdc: starting...
W20260811 06:52:49.364777 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:52:49 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:52:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:52:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:52:49.622541 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43075
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:43075
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:49.956686 3792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:49.956975 3792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:49.957105 3792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:49.964246 3792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:52:49.964352 3792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:49.964430 3792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:49.964509 3792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:52:49.964566 3792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:52:49.974243 3792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:43075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:49.975553 3792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:49.976838 3792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:49.988718 3801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:49.988673 3805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:49.988633 3802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:49.989797 3792 server_base.cc:1034] running on GCE node
I20260811 06:52:49.990494 3792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:49.991791 3792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:49.993054 3792 hybrid_clock.cc:648] HybridClock initialized: now 1786431169993008 us; error 35 us; skew 500 ppm
I20260811 06:52:49.993384 3792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:49 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431169, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:49.999281 3792 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:52:50.000730 3792 webserver.cc:460] Webserver started at http://127.12.145.62:43137/ using document root <none> and password file <none>
I20260811 06:52:50.001420 3792 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:50.001575 3792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:50.001878 3792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:52:50.005053 3792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "192e5450f2644d3d9e286c61b47c7611"
format_stamp: "Formatted at 2026-08-11 06:52:50 on dist-test-slave-7lbf"
server_key: "0cfcb5804c5683caebc695c3c1ae908a"
server_key_iv: "bf61b96cf7881dbe56d470fe62ce89b6"
server_key_version: "encryptionkey@0"
I20260811 06:52:50.005986 3792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "192e5450f2644d3d9e286c61b47c7611"
format_stamp: "Formatted at 2026-08-11 06:52:50 on dist-test-slave-7lbf"
server_key: "0cfcb5804c5683caebc695c3c1ae908a"
server_key_iv: "bf61b96cf7881dbe56d470fe62ce89b6"
server_key_version: "encryptionkey@0"
I20260811 06:52:50.011415 3792 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260811 06:52:50.015187 3816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:50.016667 3792 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:52:50.016860 3792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "192e5450f2644d3d9e286c61b47c7611"
format_stamp: "Formatted at 2026-08-11 06:52:50 on dist-test-slave-7lbf"
server_key: "0cfcb5804c5683caebc695c3c1ae908a"
server_key_iv: "bf61b96cf7881dbe56d470fe62ce89b6"
server_key_version: "encryptionkey@0"
I20260811 06:52:50.017071 3792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:50.050282 3792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:50.054425 3792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:50.054699 3792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:50.072863 3792 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:43075
I20260811 06:52:50.072901 3900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:43075 every 8 connection(s)
I20260811 06:52:50.074327 3792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:52:50.078038 3902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:50.084599 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 3792
I20260811 06:52:50.084841 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:52:50.085741 12868 external_mini_cluster.cc:1428] Setting key 26d69faa667ca9e0c1ecbfe9eb84baa0
I20260811 06:52:50.089208 3902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Bootstrap starting.
I20260811 06:52:50.092711 3902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:50.093912 3902 log.cc:824] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:50.096903 3902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: No bootstrap required, opened a new log
Aug 11 06:52:50 dist-test-slave-7lbf krb5kdc[3771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:50.106389 3902 raft_consensus.cc:348] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:50.106778 3902 raft_consensus.cc:374] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:50.106889 3902 raft_consensus.cc:729] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192e5450f2644d3d9e286c61b47c7611, State: Initialized, Role: FOLLOWER
I20260811 06:52:50.107577 3902 consensus_queue.cc:260] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:50.107875 3902 raft_consensus.cc:388] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:52:50.108044 3902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:52:50.108246 3902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:50.109215 3908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:50.087805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55946 (local address 127.12.145.62:43075)
0811 06:52:50.088584 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:50.088596 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:50.088637 (+ 41us) server_negotiation.cc:407] Connection header received
0811 06:52:50.090379 (+ 1742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:50.090402 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:50.090804 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:50.091132 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:50.092921 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:50.094373 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:50.096066 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:50.096723 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:50.096854 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:50.101874 (+ 5020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:50.101881 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:50.101895 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:50.101940 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:50.104983 (+ 3043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:50.105825 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:50.105831 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:50.105838 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:50.106014 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:50.106412 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:50.106415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:50.106417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:50.107031 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:50.107350 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:50.107715 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 06:52:50.108136 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":362,"threads_started":1}
I20260811 06:52:50.110733 3902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:50.111251 3902 leader_election.cc:302] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 192e5450f2644d3d9e286c61b47c7611; no voters:
I20260811 06:52:50.111889 3902 leader_election.cc:288] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:52:50.112008 3911 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:52:50.112691 3911 raft_consensus.cc:686] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 1 LEADER]: Becoming Leader. State: Replica: 192e5450f2644d3d9e286c61b47c7611, State: Running, Role: LEADER
I20260811 06:52:50.113291 3911 consensus_queue.cc:237] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:50.114214 3902 sys_catalog.cc:564] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:52:50.116123 3912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "192e5450f2644d3d9e286c61b47c7611" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } } }
I20260811 06:52:50.116513 3912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:50.117244 3914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 192e5450f2644d3d9e286c61b47c7611. Latest consensus state: current_term: 1 leader_uuid: "192e5450f2644d3d9e286c61b47c7611" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } } }
I20260811 06:52:50.117585 3914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:50.119046 3917 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:52:50.123912 3917 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:52:50.131932 3917 catalog_manager.cc:1347] Generated new cluster ID: 8f46b86b48904d75bfd8cf3f55d63601
I20260811 06:52:50.132051 3917 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:52:50.152129 3917 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:52:50.154079 3917 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:52:50.165498 3917 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Generated new TSK 0
I20260811 06:52:50.166584 3917 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:52:50.237495 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43075
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:50.565752 3949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:50.566025 3949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:50.566164 3949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:50.573231 3949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:50.573346 3949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:50.573509 3949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:52:50.583491 3949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:50.584867 3949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:50.586179 3949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:50.598685 3961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:50.598728 3958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:50.598973 3957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:50.599817 3949 server_base.cc:1034] running on GCE node
I20260811 06:52:50.600427 3949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:50.601338 3949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:50.602555 3949 hybrid_clock.cc:648] HybridClock initialized: now 1786431170602483 us; error 54 us; skew 500 ppm
I20260811 06:52:50.602901 3949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:50 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431170, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:50.606068 3949 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:52:50.607419 3949 webserver.cc:460] Webserver started at http://127.12.145.1:34107/ using document root <none> and password file <none>
I20260811 06:52:50.608053 3949 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:50.608168 3949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:50.608534 3949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:52:50.612360 3949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "c39ffa643a0845e39af4f07253d02e83"
format_stamp: "Formatted at 2026-08-11 06:52:50 on dist-test-slave-7lbf"
server_key: "eab1f644bb3099ad663f901118e6c8f9"
server_key_iv: "3c41080cff84d9f7037ef7530aaf1c4d"
server_key_version: "encryptionkey@0"
I20260811 06:52:50.613349 3949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "c39ffa643a0845e39af4f07253d02e83"
format_stamp: "Formatted at 2026-08-11 06:52:50 on dist-test-slave-7lbf"
server_key: "eab1f644bb3099ad663f901118e6c8f9"
server_key_iv: "3c41080cff84d9f7037ef7530aaf1c4d"
server_key_version: "encryptionkey@0"
I20260811 06:52:50.618497 3949 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260811 06:52:50.621870 3972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:50.623189 3949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 06:52:50.623327 3949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "c39ffa643a0845e39af4f07253d02e83"
format_stamp: "Formatted at 2026-08-11 06:52:50 on dist-test-slave-7lbf"
server_key: "eab1f644bb3099ad663f901118e6c8f9"
server_key_iv: "3c41080cff84d9f7037ef7530aaf1c4d"
server_key_version: "encryptionkey@0"
I20260811 06:52:50.623488 3949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:50.641806 3949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:50.645421 3949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:50.645709 3949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:50.646570 3949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:50.647838 3949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:50.647908 3949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:50.648005 3949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:50.648046 3949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:50.677104 3949 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:44801
I20260811 06:52:50.677145 4153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:44801 every 8 connection(s)
I20260811 06:52:50.678408 3949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:52:50.685501 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 3949
I20260811 06:52:50.685730 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:52:50.686571 12868 external_mini_cluster.cc:1428] Setting key c09bdc6e911ab3874c15ba3b32cce2d3
Aug 11 06:52:50 dist-test-slave-7lbf krb5kdc[3771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431170, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:50.697896 4158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:50.680843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:38321 (local address 127.12.145.62:43075)
0811 06:52:50.681269 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:50.681273 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:50.682145 (+ 872us) server_negotiation.cc:407] Connection header received
0811 06:52:50.683931 (+ 1786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:50.683937 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:50.684028 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:50.684127 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:50.685684 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:50.686783 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:50.688458 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:50.689016 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:50.689154 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:50.692597 (+ 3443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:50.692602 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:50.692605 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:50.692639 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:50.695006 (+ 2367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:50.695793 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:50.695797 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:50.695800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:50.695916 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:50.696323 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:50.696326 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:50.696328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:50.696572 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:50.696682 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:50.697424 (+ 742us) server_negotiation.cc:299] Negotiation successful
0811 06:52:50.697627 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":226,"threads_started":1}
I20260811 06:52:50.699071 4161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:50.681287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:38321)
0811 06:52:50.681994 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:50.682033 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:50.683661 (+ 1628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:50.684385 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:50.684393 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:50.684896 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:50.685483 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:50.685503 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:50.686944 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:50.686948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:50.688312 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:50.688328 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:50.689224 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:50.689230 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:50.689431 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:50.690068 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:50.690095 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:50.692367 (+ 2272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:50.695142 (+ 2775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:50.695150 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:50.695164 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:50.695691 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:50.696007 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:50.696011 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:50.696014 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:50.696233 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:50.696684 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:50.696691 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:50.697067 (+ 376us) client_negotiation.cc:769] Sending connection context
0811 06:52:50.697351 (+ 284us) client_negotiation.cc:240] Negotiation successful
0811 06:52:50.697853 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":279,"threads_started":1}
I20260811 06:52:50.700524 4155 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43075
I20260811 06:52:50.700848 4155 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:50.701713 4155 heartbeater.cc:511] Master 127.12.145.62:43075 requested a full tablet report, sending...
I20260811 06:52:50.704038 3842 ts_manager.cc:194] Registered new tserver with Master: c39ffa643a0845e39af4f07253d02e83 (127.12.145.1:44801)
I20260811 06:52:50.705551 3842 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:38321
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:52:50.744874 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43075
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:51.070243 4166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:51.070547 4166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:51.070673 4166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:51.078011 4166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:51.078116 4166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:51.078272 4166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:52:51.087845 4166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:51.089043 4166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:51.090384 4166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:51.102449 4177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:51.103149 4180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:51.104257 4183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:51.104578 4166 server_base.cc:1034] running on GCE node
I20260811 06:52:51.105217 4166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:51.106217 4166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:51.107431 4166 hybrid_clock.cc:648] HybridClock initialized: now 1786431171107377 us; error 46 us; skew 500 ppm
I20260811 06:52:51.107735 4166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:51 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:51.110841 4166 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:52:51.112166 4166 webserver.cc:460] Webserver started at http://127.12.145.2:37123/ using document root <none> and password file <none>
I20260811 06:52:51.112843 4166 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:51.112942 4166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:51.113185 4166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:52:51.116212 4166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "4358a1e72e774dd9a53793ed190b76b4"
format_stamp: "Formatted at 2026-08-11 06:52:51 on dist-test-slave-7lbf"
server_key: "a71a1d62ba73c5e8c411779df5dae1db"
server_key_iv: "60b1b22d1236b039d3c16480e412451c"
server_key_version: "encryptionkey@0"
I20260811 06:52:51.116951 4166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "4358a1e72e774dd9a53793ed190b76b4"
format_stamp: "Formatted at 2026-08-11 06:52:51 on dist-test-slave-7lbf"
server_key: "a71a1d62ba73c5e8c411779df5dae1db"
server_key_iv: "60b1b22d1236b039d3c16480e412451c"
server_key_version: "encryptionkey@0"
I20260811 06:52:51.122460 4166 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 06:52:51.125967 4200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:51.127310 4166 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 06:52:51.127467 4166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "4358a1e72e774dd9a53793ed190b76b4"
format_stamp: "Formatted at 2026-08-11 06:52:51 on dist-test-slave-7lbf"
server_key: "a71a1d62ba73c5e8c411779df5dae1db"
server_key_iv: "60b1b22d1236b039d3c16480e412451c"
server_key_version: "encryptionkey@0"
I20260811 06:52:51.127635 4166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:51.145803 4166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:51.149722 4166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:51.149991 4166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:51.150913 4166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:51.152252 4166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:51.152325 4166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:51.152415 4166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:51.152456 4166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:51.182955 4166 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:33995
I20260811 06:52:51.183005 4389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:33995 every 8 connection(s)
I20260811 06:52:51.184286 4166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:52:51.188637 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 4166
I20260811 06:52:51.188810 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:52:51.189241 12868 external_mini_cluster.cc:1428] Setting key 8d3037489059efc2ee3b5db7dff0cbf1
Aug 11 06:52:51 dist-test-slave-7lbf krb5kdc[3771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:51.205641 4158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.186871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:37293 (local address 127.12.145.62:43075)
0811 06:52:51.187083 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:51.187089 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:51.188370 (+ 1281us) server_negotiation.cc:407] Connection header received
0811 06:52:51.190430 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:51.190434 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:51.190501 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:51.190599 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:51.192251 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.193209 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.195080 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.195638 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.195765 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.199301 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:51.199308 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:51.199313 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:51.199355 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:51.202371 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:51.203309 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:51.203313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:51.203315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:51.203443 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:51.203934 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:51.203939 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:51.203941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:51.204216 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:51.204326 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:51.205187 (+ 861us) server_negotiation.cc:299] Negotiation successful
0811 06:52:51.205363 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 06:52:51.207005 4394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.187397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:37293)
0811 06:52:51.188164 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:51.188211 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:51.190123 (+ 1912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:51.190883 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:51.190895 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:51.191475 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:51.192067 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:51.192086 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.193380 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.193384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:51.194927 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:51.194941 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.195875 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.195881 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:51.196082 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.196717 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:51.196745 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:51.199068 (+ 2323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:51.202533 (+ 3465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:51.202542 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:51.202559 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:51.203179 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:51.203546 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:51.203550 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:51.203553 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:51.203809 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:51.204341 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:51.204349 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:51.204771 (+ 422us) client_negotiation.cc:769] Sending connection context
0811 06:52:51.205069 (+ 298us) client_negotiation.cc:240] Negotiation successful
0811 06:52:51.205624 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":331,"threads_started":1}
I20260811 06:52:51.208505 4391 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43075
I20260811 06:52:51.208822 4391 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:51.209617 4391 heartbeater.cc:511] Master 127.12.145.62:43075 requested a full tablet report, sending...
I20260811 06:52:51.211136 3842 ts_manager.cc:194] Registered new tserver with Master: 4358a1e72e774dd9a53793ed190b76b4 (127.12.145.2:33995)
I20260811 06:52:51.212193 3842 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:37293
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:52:51.250674 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43075
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:51.584668 4400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:51.584971 4400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:51.585124 4400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:51.592367 4400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:51.592473 4400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:51.592629 4400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:52:51.602365 4400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:51.603700 4400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:51.605034 4400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:51.618089 4413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:51.618139 4415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:51.618161 4408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:51.619012 4400 server_base.cc:1034] running on GCE node
I20260811 06:52:51.619872 4400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:51.620986 4400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:51.622200 4400 hybrid_clock.cc:648] HybridClock initialized: now 1786431171622150 us; error 39 us; skew 500 ppm
I20260811 06:52:51.622534 4400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:51 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:51.625753 4400 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:52:51.627171 4400 webserver.cc:460] Webserver started at http://127.12.145.3:43641/ using document root <none> and password file <none>
I20260811 06:52:51.627797 4400 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:51.627909 4400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:51.628206 4400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:52:51.631301 4400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "f65ba86c7f04432e9b7f6171a7b919d4"
format_stamp: "Formatted at 2026-08-11 06:52:51 on dist-test-slave-7lbf"
server_key: "1b0585d20b3bafdcca92816aeb6b4f37"
server_key_iv: "d7c692291daf60cfb98122eb8b0177b6"
server_key_version: "encryptionkey@0"
I20260811 06:52:51.632087 4400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "f65ba86c7f04432e9b7f6171a7b919d4"
format_stamp: "Formatted at 2026-08-11 06:52:51 on dist-test-slave-7lbf"
server_key: "1b0585d20b3bafdcca92816aeb6b4f37"
server_key_iv: "d7c692291daf60cfb98122eb8b0177b6"
server_key_version: "encryptionkey@0"
I20260811 06:52:51.637050 4400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:52:51.640501 4430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:51.641918 4400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:52:51.642086 4400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "f65ba86c7f04432e9b7f6171a7b919d4"
format_stamp: "Formatted at 2026-08-11 06:52:51 on dist-test-slave-7lbf"
server_key: "1b0585d20b3bafdcca92816aeb6b4f37"
server_key_iv: "d7c692291daf60cfb98122eb8b0177b6"
server_key_version: "encryptionkey@0"
I20260811 06:52:51.642267 4400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:51.664083 4400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:51.667927 4400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:51.668200 4400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:51.669138 4400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:51.670475 4400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:51.670568 4400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:51.670691 4400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:51.670742 4400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:51.702540 4400 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:39279
I20260811 06:52:51.702596 4621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:39279 every 8 connection(s)
I20260811 06:52:51.703763 4400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:52:51.704257 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 4400
I20260811 06:52:51.704430 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:52:51.705046 12868 external_mini_cluster.cc:1428] Setting key 312faff8211185f6e0b8ab40c141651d
I20260811 06:52:51.708802 4155 heartbeater.cc:503] Master 127.12.145.62:43075 was elected leader, sending a full tablet report...
Aug 11 06:52:51 dist-test-slave-7lbf krb5kdc[3771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:51.724177 4630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.706684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:59205 (local address 127.12.145.62:43075)
0811 06:52:51.707090 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:51.707095 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:51.709576 (+ 2481us) server_negotiation.cc:407] Connection header received
0811 06:52:51.710261 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:51.710267 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:51.710351 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:51.710446 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:51.711918 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.712703 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.714302 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.714728 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.714838 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.718344 (+ 3506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:51.718350 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:51.718353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:51.718385 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:51.721196 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:51.721960 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:51.721965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:51.721969 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:51.722097 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:51.722516 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:51.722521 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:51.722525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:51.722781 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:51.722913 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:51.723592 (+ 679us) server_negotiation.cc:299] Negotiation successful
0811 06:52:51.723819 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":197,"threads_started":1}
I20260811 06:52:51.725147 4631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.707325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:59205)
0811 06:52:51.708103 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:51.708141 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:51.710013 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:51.710725 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:51.710733 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:51.711223 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:51.711755 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:51.711772 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.712850 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.712854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:51.714163 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:51.714175 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.714944 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.714952 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:51.715176 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.715804 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:51.715826 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:51.718146 (+ 2320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:51.721339 (+ 3193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:51.721347 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:51.721362 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:51.721836 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:51.722199 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:51.722204 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:51.722208 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:51.722392 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:51.722906 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:51.722914 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:51.723226 (+ 312us) client_negotiation.cc:769] Sending connection context
0811 06:52:51.723449 (+ 223us) client_negotiation.cc:240] Negotiation successful
0811 06:52:51.723939 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":312,"threads_started":1}
I20260811 06:52:51.726342 4623 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43075
I20260811 06:52:51.726624 4623 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:51.727377 4623 heartbeater.cc:511] Master 127.12.145.62:43075 requested a full tablet report, sending...
I20260811 06:52:51.728752 3842 ts_manager.cc:194] Registered new tserver with Master: f65ba86c7f04432e9b7f6171a7b919d4 (127.12.145.3:39279)
I20260811 06:52:51.729598 3842 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:59205
I20260811 06:52:51.732759 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:52:51.752817 4630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.740902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55950 (local address 127.12.145.62:43075)
0811 06:52:51.741102 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:51.741109 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:51.741489 (+ 380us) server_negotiation.cc:407] Connection header received
0811 06:52:51.741664 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:51.741667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:51.741751 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:51.741830 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:51.743098 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.743797 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.745032 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.745482 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.745628 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.747913 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:51.747918 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:51.747921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:51.747952 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:51.750248 (+ 2296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:51.750911 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:51.750915 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:51.750918 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:51.751036 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:51.751421 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:51.751426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:51.751428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:51.751745 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:51.751977 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:51.752314 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 06:52:51.752534 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:52:51.756573 3842 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:52:51.763353 3842 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:52:51.795414 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.775551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56446 (local address 127.12.145.3:39279)
0811 06:52:51.786723 (+ 11172us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:51.786733 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:51.786770 (+ 37us) server_negotiation.cc:407] Connection header received
0811 06:52:51.786890 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:51.786898 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:51.787168 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:51.787371 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:51.788475 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.789879 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.792608 (+ 2729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.793686 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.793802 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.794039 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:51.794936 (+ 897us) server_negotiation.cc:299] Negotiation successful
0811 06:52:51.795112 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11006,"thread_start_us":10861,"threads_started":1}
I20260811 06:52:51.795830 4665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.777208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46506 (local address 127.12.145.1:44801)
0811 06:52:51.787096 (+ 9888us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:51.787104 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:51.788185 (+ 1081us) server_negotiation.cc:407] Connection header received
0811 06:52:51.788286 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:51.788293 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:51.788514 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:51.788696 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:51.789449 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.790847 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.793021 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.794412 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.794536 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.794726 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:51.795375 (+ 649us) server_negotiation.cc:299] Negotiation successful
0811 06:52:51.795540 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9708,"thread_start_us":9705,"threads_started":1}
I20260811 06:52:51.795950 4663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.776714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48780 (local address 127.12.145.2:33995)
0811 06:52:51.787537 (+ 10823us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:51.787545 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:51.787570 (+ 25us) server_negotiation.cc:407] Connection header received
0811 06:52:51.787675 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:51.787682 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:51.787884 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:51.788087 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:51.788899 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.790234 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.792829 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.794223 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.794380 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.794564 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:51.795308 (+ 744us) server_negotiation.cc:299] Negotiation successful
0811 06:52:51.795465 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10675,"thread_start_us":10522,"threads_started":1}
I20260811 06:52:51.796067 4651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.775276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:39279 (local address 127.0.0.1:56446)
0811 06:52:51.775927 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:51.775988 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:51.776152 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:51.787703 (+ 11551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:51.787710 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:51.787745 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:51.788235 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:51.788250 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.790002 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.790007 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:51.792441 (+ 2434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:51.792457 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.793859 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.793866 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:51.794054 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.794104 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 06:52:51.794224 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 06:52:51.794413 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"mutex_wait_us":41,"thread_start_us":248,"threads_started":1}
I20260811 06:52:51.796654 4656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.775996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:33995 (local address 127.0.0.1:48780)
0811 06:52:51.785858 (+ 9862us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:51.785879 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:51.786017 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:51.788327 (+ 2310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:51.788332 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:51.788357 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:51.788722 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:51.788735 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.790367 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.790373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:51.792679 (+ 2306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:51.792690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.794729 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.794737 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:51.794935 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.794969 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 06:52:51.795052 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 06:52:51.795172 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9701,"mutex_wait_us":87,"thread_start_us":10100,"threads_started":1}
I20260811 06:52:51.796674 4659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:51.776338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.0.0.1:46506)
0811 06:52:51.787886 (+ 11548us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:51.787904 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:51.788044 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:51.788906 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:51.788910 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:51.788934 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:51.789255 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:51.789266 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.791030 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.791035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:51.792863 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:51.792878 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:51.794910 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:51.794917 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:51.795059 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:51.795086 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 06:52:51.795154 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 06:52:51.795601 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11420,"mutex_wait_us":18,"thread_start_us":11258,"threads_started":1}
I20260811 06:52:51.800187 4063 tablet_service.cc:1467] Processing CreateTablet for tablet 535c04bd8a164b5a9685acbdc7a1d404 (DEFAULT_TABLE table=test-table [id=d4fd5cb59cd14c3d8aac092b151b1c3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:52:51.800213 4270 tablet_service.cc:1467] Processing CreateTablet for tablet 535c04bd8a164b5a9685acbdc7a1d404 (DEFAULT_TABLE table=test-table [id=d4fd5cb59cd14c3d8aac092b151b1c3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:52:51.800215 4514 tablet_service.cc:1467] Processing CreateTablet for tablet 535c04bd8a164b5a9685acbdc7a1d404 (DEFAULT_TABLE table=test-table [id=d4fd5cb59cd14c3d8aac092b151b1c3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:52:51.801421 4063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 535c04bd8a164b5a9685acbdc7a1d404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:51.801574 4270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 535c04bd8a164b5a9685acbdc7a1d404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:51.801573 4514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 535c04bd8a164b5a9685acbdc7a1d404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:51.813447 4666 tablet_bootstrap.cc:492] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Bootstrap starting.
I20260811 06:52:51.817293 4666 tablet_bootstrap.cc:654] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:51.817777 4667 tablet_bootstrap.cc:492] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: Bootstrap starting.
I20260811 06:52:51.817879 4668 tablet_bootstrap.cc:492] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: Bootstrap starting.
I20260811 06:52:51.818724 4666 log.cc:824] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:51.821399 4668 tablet_bootstrap.cc:654] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:51.821399 4667 tablet_bootstrap.cc:654] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:51.822188 4666 tablet_bootstrap.cc:492] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: No bootstrap required, opened a new log
I20260811 06:52:51.822458 4666 ts_tablet_manager.cc:1397] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 06:52:51.822621 4668 log.cc:824] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:51.822631 4667 log.cc:824] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:51.825253 4668 tablet_bootstrap.cc:492] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: No bootstrap required, opened a new log
I20260811 06:52:51.825507 4668 ts_tablet_manager.cc:1397] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 06:52:51.832090 4667 tablet_bootstrap.cc:492] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: No bootstrap required, opened a new log
I20260811 06:52:51.832360 4667 ts_tablet_manager.cc:1397] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20260811 06:52:51.832696 4666 raft_consensus.cc:348] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:51.833149 4666 raft_consensus.cc:374] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:51.833279 4666 raft_consensus.cc:729] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39ffa643a0845e39af4f07253d02e83, State: Initialized, Role: FOLLOWER
I20260811 06:52:51.833617 4668 raft_consensus.cc:348] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:51.833994 4668 raft_consensus.cc:374] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:51.834105 4668 raft_consensus.cc:729] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f65ba86c7f04432e9b7f6171a7b919d4, State: Initialized, Role: FOLLOWER
I20260811 06:52:51.833932 4666 consensus_queue.cc:260] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:51.834673 4668 consensus_queue.cc:260] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:51.837178 4623 heartbeater.cc:503] Master 127.12.145.62:43075 was elected leader, sending a full tablet report...
I20260811 06:52:51.837818 4668 ts_tablet_manager.cc:1428] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260811 06:52:51.842643 4667 raft_consensus.cc:348] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:51.843138 4667 raft_consensus.cc:374] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:51.843158 4666 ts_tablet_manager.cc:1428] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Time spent starting tablet: real 0.021s user 0.018s sys 0.000s
I20260811 06:52:51.843299 4667 raft_consensus.cc:729] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4358a1e72e774dd9a53793ed190b76b4, State: Initialized, Role: FOLLOWER
I20260811 06:52:51.843868 4667 consensus_queue.cc:260] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:51.845392 4391 heartbeater.cc:503] Master 127.12.145.62:43075 was elected leader, sending a full tablet report...
I20260811 06:52:51.845393 4667 ts_tablet_manager.cc:1428] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260811 06:52:51.930697 4156 tablet.cc:2369] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:52:51.936111 4392 tablet.cc:2369] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:52:51.955657 4629 tablet.cc:2369] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:52:52.001464 4675 raft_consensus.cc:482] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:52:52.001821 4675 raft_consensus.cc:504] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:52.003650 4675 leader_election.cc:288] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c39ffa643a0845e39af4f07253d02e83 (127.12.145.1:44801), 4358a1e72e774dd9a53793ed190b76b4 (127.12.145.2:33995)
I20260811 06:52:52.010593 4663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.004225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:39487 (local address 127.12.145.2:33995)
0811 06:52:52.004441 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:52.004448 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:52.004472 (+ 24us) server_negotiation.cc:407] Connection header received
0811 06:52:52.004607 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:52.004613 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:52.004694 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:52.004795 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:52.005267 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.006303 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.008659 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.009814 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.009989 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:52.010069 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:52.010251 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 06:52:52.010378 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 06:52:52.010733 4631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.003950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:33995 (local address 127.12.145.3:39487)
0811 06:52:52.004277 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:52.004314 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:52.004456 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:52.004840 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:52.004845 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:52.004878 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:52.005115 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:52.005124 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.006449 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.006452 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:52.008507 (+ 2055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:52.008523 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.009956 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.009960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:52.010101 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:52.010127 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 06:52:52.010214 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 06:52:52.010365 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":60,"spinlock_wait_cycles":24320}
I20260811 06:52:52.011014 4665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.004131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:33421 (local address 127.12.145.1:44801)
0811 06:52:52.004314 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:52.004320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:52.004915 (+ 595us) server_negotiation.cc:407] Connection header received
0811 06:52:52.005021 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:52.005024 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:52.005082 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:52.005149 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:52.005654 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.006607 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.008902 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.010111 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.010243 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:52.010308 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:52.010658 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 06:52:52.010787 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 06:52:52.011124 4679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.004059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.12.145.3:33421)
0811 06:52:52.004781 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:52.004807 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:52.004918 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:52.005191 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:52.005196 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:52.005219 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:52.005480 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:52.005488 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.006742 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.006747 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:52.008749 (+ 2002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:52.008759 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.010304 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.010310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:52.010467 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:52.010500 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 06:52:52.010606 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 06:52:52.010735 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"mutex_wait_us":1,"thread_start_us":431,"threads_started":1}
I20260811 06:52:52.011942 4311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "535c04bd8a164b5a9685acbdc7a1d404" candidate_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4358a1e72e774dd9a53793ed190b76b4" is_pre_election: true
I20260811 06:52:52.012208 4088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "535c04bd8a164b5a9685acbdc7a1d404" candidate_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39ffa643a0845e39af4f07253d02e83" is_pre_election: true
I20260811 06:52:52.012462 4311 raft_consensus.cc:2454] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f65ba86c7f04432e9b7f6171a7b919d4 in term 0.
I20260811 06:52:52.012696 4088 raft_consensus.cc:2454] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f65ba86c7f04432e9b7f6171a7b919d4 in term 0.
I20260811 06:52:52.013152 4437 leader_election.cc:302] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4358a1e72e774dd9a53793ed190b76b4, f65ba86c7f04432e9b7f6171a7b919d4; no voters:
I20260811 06:52:52.013566 4675 raft_consensus.cc:2781] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:52:52.013717 4675 raft_consensus.cc:482] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:52:52.013823 4675 raft_consensus.cc:3037] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:52.016131 4675 raft_consensus.cc:504] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:52.016739 4675 leader_election.cc:288] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [CANDIDATE]: Term 1 election: Requested vote from peers c39ffa643a0845e39af4f07253d02e83 (127.12.145.1:44801), 4358a1e72e774dd9a53793ed190b76b4 (127.12.145.2:33995)
I20260811 06:52:52.017171 4088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "535c04bd8a164b5a9685acbdc7a1d404" candidate_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39ffa643a0845e39af4f07253d02e83"
I20260811 06:52:52.017256 4311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "535c04bd8a164b5a9685acbdc7a1d404" candidate_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4358a1e72e774dd9a53793ed190b76b4"
I20260811 06:52:52.017354 4088 raft_consensus.cc:3037] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:52.017482 4311 raft_consensus.cc:3037] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:52.019577 4088 raft_consensus.cc:2454] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f65ba86c7f04432e9b7f6171a7b919d4 in term 1.
I20260811 06:52:52.019871 4311 raft_consensus.cc:2454] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f65ba86c7f04432e9b7f6171a7b919d4 in term 1.
I20260811 06:52:52.019953 4434 leader_election.cc:302] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c39ffa643a0845e39af4f07253d02e83, f65ba86c7f04432e9b7f6171a7b919d4; no voters:
I20260811 06:52:52.020243 4675 raft_consensus.cc:2781] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:52:52.020699 4675 raft_consensus.cc:686] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 1 LEADER]: Becoming Leader. State: Replica: f65ba86c7f04432e9b7f6171a7b919d4, State: Running, Role: LEADER
I20260811 06:52:52.021277 4675 consensus_queue.cc:237] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:52.026226 3840 catalog_manager.cc:5495] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f65ba86c7f04432e9b7f6171a7b919d4 (127.12.145.3). New cstate: current_term: 1 leader_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } health_report { overall_health: UNKNOWN } } }
I20260811 06:52:52.091243 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.086186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56456 (local address 127.12.145.3:39279)
0811 06:52:52.086389 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:52.086394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:52.086413 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:52:52.086539 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:52.086542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:52.086633 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:52.086765 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:52:52.087068 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.087766 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.089145 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.089564 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.089652 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:52.090262 (+ 610us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:52:52.090794 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:52:52.090937 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:52.090974 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 06:52:52.091039 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 06:52:52.099471 4311 raft_consensus.cc:1261] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4 [term 1 FOLLOWER]: Refusing update from remote peer f65ba86c7f04432e9b7f6171a7b919d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:52:52.099499 4088 raft_consensus.cc:1261] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83 [term 1 FOLLOWER]: Refusing update from remote peer f65ba86c7f04432e9b7f6171a7b919d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:52:52.100482 4675 consensus_queue.cc:1035] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:52:52.100824 4680 consensus_queue.cc:1035] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:52:52.135833 3840 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:52:52.136101 3840 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:52:52.139833 3840 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Sending DeleteTablet for 3 replicas of tablet 535c04bd8a164b5a9685acbdc7a1d404
I20260811 06:52:52.141225 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 3949
I20260811 06:52:52.141268 4270 tablet_service.cc:1514] Processing DeleteTablet for tablet 535c04bd8a164b5a9685acbdc7a1d404 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:52:52 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:48780
I20260811 06:52:52.141270 4063 tablet_service.cc:1514] Processing DeleteTablet for tablet 535c04bd8a164b5a9685acbdc7a1d404 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:52:52 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:46506
I20260811 06:52:52.142038 4514 tablet_service.cc:1514] Processing DeleteTablet for tablet 535c04bd8a164b5a9685acbdc7a1d404 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:52:52 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:56446
I20260811 06:52:52.142958 4700 tablet_replica.cc:330] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: stopping tablet replica
I20260811 06:52:52.143464 4700 raft_consensus.cc:2229] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:52:52.144222 4700 raft_consensus.cc:2258] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:52:52.146739 4700 ts_tablet_manager.cc:1905] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:52:52.154899 4700 ts_tablet_manager.cc:1918] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:52:52.154938 4703 tablet_replica.cc:330] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: stopping tablet replica
I20260811 06:52:52.155134 4700 log.cc:1196] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/535c04bd8a164b5a9685acbdc7a1d404
I20260811 06:52:52.155733 4700 ts_tablet_manager.cc:1939] T 535c04bd8a164b5a9685acbdc7a1d404 P f65ba86c7f04432e9b7f6171a7b919d4: Deleting consensus metadata
I20260811 06:52:52.155717 4703 raft_consensus.cc:2229] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:52:52.156497 4703 raft_consensus.cc:2258] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:52:52.157655 4697 tablet_replica.cc:330] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: stopping tablet replica
I20260811 06:52:52.157900 3819 catalog_manager.cc:4841] TS f65ba86c7f04432e9b7f6171a7b919d4 (127.12.145.3:39279): tablet 535c04bd8a164b5a9685acbdc7a1d404 (table test-table [id=d4fd5cb59cd14c3d8aac092b151b1c3f]) successfully deleted
I20260811 06:52:52.158310 4697 raft_consensus.cc:2229] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:52:52.158913 4697 raft_consensus.cc:2258] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:52:52.159266 4703 ts_tablet_manager.cc:1905] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:52:52.161639 4697 ts_tablet_manager.cc:1905] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 06:52:52 dist-test-slave-7lbf krb5kdc[3771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:52:52.166586 4703 ts_tablet_manager.cc:1918] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:52:52.166769 4703 log.cc:1196] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/535c04bd8a164b5a9685acbdc7a1d404
I20260811 06:52:52.167378 4703 ts_tablet_manager.cc:1939] T 535c04bd8a164b5a9685acbdc7a1d404 P 4358a1e72e774dd9a53793ed190b76b4: Deleting consensus metadata
I20260811 06:52:52.169390 3823 catalog_manager.cc:4841] TS 4358a1e72e774dd9a53793ed190b76b4 (127.12.145.2:33995): tablet 535c04bd8a164b5a9685acbdc7a1d404 (table test-table [id=d4fd5cb59cd14c3d8aac092b151b1c3f]) successfully deleted
I20260811 06:52:52.172169 4665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.142091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46512 (local address 127.12.145.1:44801)
0811 06:52:52.142265 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:52.142271 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:52.154703 (+ 12432us) server_negotiation.cc:407] Connection header received
0811 06:52:52.155284 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:52.155291 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:52.155383 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:52.155460 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:52.157879 (+ 2419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.158881 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.160911 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.161830 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.162025 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:52.166310 (+ 4285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:52.166323 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:52.166336 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:52.166374 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:52.169066 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:52.169935 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:52.169944 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:52.169946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:52.170109 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:52.170503 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:52.170509 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:52.170512 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:52.170901 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:52.171254 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:52.171558 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 06:52:52.171793 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:52:52.172806 4149 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:52.275388 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 3949
W20260811 06:52:52.307835 3819 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.1:44801 (error 108)
I20260811 06:52:52.308194 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 4166
I20260811 06:52:52.310117 4710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.309156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.0.0.1:46518)
0811 06:52:52.309778 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:52.309910 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:44801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":402,"threads_started":1}
W20260811 06:52:52.310408 3819 catalog_manager.cc:4584] TS c39ffa643a0845e39af4f07253d02e83 (127.12.145.1:44801): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 535c04bd8a164b5a9685acbdc7a1d404: Network error: Client connection negotiation failed: client connection to 127.12.145.1:44801: connect: Connection refused (error 111)
Aug 11 06:52:52 dist-test-slave-7lbf krb5kdc[3771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:52:52.324477 4663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.309154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48788 (local address 127.12.145.2:33995)
0811 06:52:52.309363 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:52.309369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:52.309392 (+ 23us) server_negotiation.cc:407] Connection header received
0811 06:52:52.309698 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:52.309704 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:52.309787 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:52.309891 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:52.311383 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.312159 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.313429 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.313979 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.314102 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:52.318667 (+ 4565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:52.318684 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:52.318699 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:52.318747 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:52.321653 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:52.322362 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:52.322371 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:52.322373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:52.322500 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:52.322874 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:52.322878 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:52.322880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:52.323292 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:52.323570 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:52.323925 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 06:52:52.324152 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 06:52:52.325229 4384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:52.364413 4710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.363835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.0.0.1:46534)
0811 06:52:52.364110 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:52.364235 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:44801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 06:52:52.365681 4710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.365191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.0.0.1:46538)
0811 06:52:52.365384 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:52.365480 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:44801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 06:52:52.414270 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 4166
I20260811 06:52:52.427008 4710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.426450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.0.0.1:46552)
0811 06:52:52.426694 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:52.426814 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:44801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 06:52:52.428339 4710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.427889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.0.0.1:46554)
0811 06:52:52.428073 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:52.428167 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:44801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 06:52:52.441607 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 4400
Aug 11 06:52:52 dist-test-slave-7lbf krb5kdc[3771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:52:52.458823 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.442479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56472 (local address 127.12.145.3:39279)
0811 06:52:52.442690 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:52.442696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:52.442715 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:52:52.442778 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:52.442782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:52.442839 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:52.442935 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:52.444235 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.445114 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.446498 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:52.446959 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:52.447086 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:52.451597 (+ 4511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:52.451614 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:52.451636 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:52.451682 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:52.455749 (+ 4067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:52.456449 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:52.456459 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:52.456466 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:52.456701 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:52.457070 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:52.457079 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:52.457083 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:52.457625 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:52.458002 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:52.458161 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 06:52:52.458402 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 06:52:52.459707 4615 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:52.509043 4710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.508432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.0.0.1:46566)
0811 06:52:52.508724 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:52.508843 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:44801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 06:52:52.510247 4710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.509791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.0.0.1:46570)
0811 06:52:52.510000 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:52.510089 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:44801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 06:52:52.581081 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 4400
I20260811 06:52:52.606539 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 3792
I20260811 06:52:52.607705 3891 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:52.717772 4710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:52.717168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.0.0.1:46578)
0811 06:52:52.717381 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:52.717553 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:44801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 06:52:52.717864 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 3792
I20260811 06:52:52.745011 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43075
--webserver_interface=127.12.145.62
--webserver_port=43137
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:43075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:53.088846 4716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:53.089164 4716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:53.089318 4716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:53.096607 4716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:52:53.096735 4716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:53.096833 4716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:53.096922 4716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:52:53.096992 4716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:52:53.106904 4716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:43075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=43137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:53.108246 4716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:53.109676 4716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:53.135653 4724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:53.135656 4723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:53.135676 4727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:53.136456 4716 server_base.cc:1034] running on GCE node
I20260811 06:52:53.137323 4716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:53.139166 4716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:53.140381 4716 hybrid_clock.cc:648] HybridClock initialized: now 1786431173140319 us; error 54 us; skew 500 ppm
I20260811 06:52:53.140776 4716 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:53 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:53.144316 4716 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:52:53.145998 4716 webserver.cc:460] Webserver started at http://127.12.145.62:43137/ using document root <none> and password file <none>
I20260811 06:52:53.146762 4716 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:53.146905 4716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:53.152983 4716 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 06:52:53.156019 4741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:53.157374 4716 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 06:52:53.157572 4716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "192e5450f2644d3d9e286c61b47c7611"
format_stamp: "Formatted at 2026-08-11 06:52:50 on dist-test-slave-7lbf"
server_key: "0cfcb5804c5683caebc695c3c1ae908a"
server_key_iv: "bf61b96cf7881dbe56d470fe62ce89b6"
server_key_version: "encryptionkey@0"
I20260811 06:52:53.158710 4716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:53.180037 4716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:53.184005 4716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:53.184269 4716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:53.202193 4716 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:43075
I20260811 06:52:53.202216 4842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:43075 every 8 connection(s)
I20260811 06:52:53.203708 4716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:52:53.210258 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 4716
I20260811 06:52:53.210839 4843 sys_catalog.cc:263] Verifying existing consensus state
I20260811 06:52:53.211130 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:44801
--local_ip_for_outbound_sockets=127.12.145.1
--tserver_master_addrs=127.12.145.62:43075
--webserver_port=34107
--webserver_interface=127.12.145.1
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:52:53.214264 4843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Bootstrap starting.
I20260811 06:52:53.237892 4843 log.cc:824] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:53.253298 4843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 06:52:53.253871 4843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Bootstrap complete.
I20260811 06:52:53.263221 4843 raft_consensus.cc:348] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:53.264115 4843 raft_consensus.cc:729] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192e5450f2644d3d9e286c61b47c7611, State: Initialized, Role: FOLLOWER
I20260811 06:52:53.264725 4843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:53.264962 4843 raft_consensus.cc:388] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:52:53.265076 4843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:52:53.265240 4843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:52:53.269095 4843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:53.269646 4843 leader_election.cc:302] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 192e5450f2644d3d9e286c61b47c7611; no voters:
I20260811 06:52:53.270254 4843 leader_election.cc:288] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 06:52:53.270432 4850 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 06:52:53.271503 4850 raft_consensus.cc:686] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 2 LEADER]: Becoming Leader. State: Replica: 192e5450f2644d3d9e286c61b47c7611, State: Running, Role: LEADER
I20260811 06:52:53.272123 4850 consensus_queue.cc:237] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:53.272301 4843 sys_catalog.cc:564] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:52:53.275051 4852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 192e5450f2644d3d9e286c61b47c7611. Latest consensus state: current_term: 2 leader_uuid: "192e5450f2644d3d9e286c61b47c7611" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } } }
I20260811 06:52:53.275525 4852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:53.275463 4851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "192e5450f2644d3d9e286c61b47c7611" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } } }
I20260811 06:52:53.275810 4851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:53.287060 4860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:52:53.296396 4860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:52:53.297910 4860 catalog_manager.cc:1259] Loaded cluster ID: 8f46b86b48904d75bfd8cf3f55d63601
I20260811 06:52:53.298095 4860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:52:53.301393 4860 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 06:52:53.303112 4885 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 06:52:53.317890 4860 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 06:52:53.327558 4860 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:52:53.329449 4860 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Loaded TSK: 0
I20260811 06:52:53.331118 4860 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 06:52:53.576661 4846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:53.576941 4846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:53.577075 4846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:53.584239 4846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:53.584354 4846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:53.584517 4846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:52:53.594219 4846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:44801
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=34107
--tserver_master_addrs=127.12.145.62:43075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:53.595813 4846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:53.597201 4846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:53.611729 4896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:53.611737 4898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:53.612402 4902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:53.613173 4846 server_base.cc:1034] running on GCE node
I20260811 06:52:53.613821 4846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:53.614795 4846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:53.616022 4846 hybrid_clock.cc:648] HybridClock initialized: now 1786431173615967 us; error 50 us; skew 500 ppm
I20260811 06:52:53.616319 4846 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:53 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:53.619511 4846 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:52:53.621024 4846 webserver.cc:460] Webserver started at http://127.12.145.1:34107/ using document root <none> and password file <none>
I20260811 06:52:53.621755 4846 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:53.621896 4846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:53.627354 4846 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 06:52:53.630403 4914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:53.631781 4846 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 06:52:53.631922 4846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "c39ffa643a0845e39af4f07253d02e83"
format_stamp: "Formatted at 2026-08-11 06:52:50 on dist-test-slave-7lbf"
server_key: "eab1f644bb3099ad663f901118e6c8f9"
server_key_iv: "3c41080cff84d9f7037ef7530aaf1c4d"
server_key_version: "encryptionkey@0"
I20260811 06:52:53.632853 4846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:53.651628 4846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:53.655632 4846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:53.655894 4846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:53.656912 4846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:53.658766 4927 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260811 06:52:53.664348 4927 ts_tablet_manager.cc:1852] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260811 06:52:53.665349 4927 ts_tablet_manager.cc:1905] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:52:53.672560 4927 ts_tablet_manager.cc:1918] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:52:53.672752 4927 log.cc:1196] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/535c04bd8a164b5a9685acbdc7a1d404
I20260811 06:52:53.673210 4927 ts_tablet_manager.cc:1939] T 535c04bd8a164b5a9685acbdc7a1d404 P c39ffa643a0845e39af4f07253d02e83: Deleting consensus metadata
I20260811 06:52:53.673626 4846 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260811 06:52:53.673730 4846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.015s user 0.001s sys 0.000s
I20260811 06:52:53.673834 4846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:53.673888 4846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:53.702699 4846 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:44801
I20260811 06:52:53.702749 5110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:44801 every 8 connection(s)
I20260811 06:52:53.704104 4846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:52:53.704785 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 4846
I20260811 06:52:53.705691 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:33995
--local_ip_for_outbound_sockets=127.12.145.2
--tserver_master_addrs=127.12.145.62:43075
--webserver_port=37123
--webserver_interface=127.12.145.2
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:52:53 dist-test-slave-7lbf krb5kdc[3771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:53.728566 5114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:53.707454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:54681)
0811 06:52:53.708386 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:53.708441 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:53.710304 (+ 1863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:53.711898 (+ 1594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:53.711905 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:53.712424 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:53.712962 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:53.712982 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:53.715301 (+ 2319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:53.715305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:53.716532 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:53.716546 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:53.717976 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:53.717982 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:53.718160 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:53.718804 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:53.718827 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:53.720948 (+ 2121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:53.724246 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:53.724256 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:53.724272 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:53.724701 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:53.725148 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:53.725153 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:53.725157 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:53.725329 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:53.726120 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:53.726129 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:53.726440 (+ 311us) client_negotiation.cc:769] Sending connection context
0811 06:52:53.726706 (+ 266us) client_negotiation.cc:240] Negotiation successful
0811 06:52:53.727248 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":428,"threads_started":1}
I20260811 06:52:53.728566 5113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:53.707332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:54681 (local address 127.12.145.62:43075)
0811 06:52:53.708014 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:53.708031 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:53.708601 (+ 570us) server_negotiation.cc:407] Connection header received
0811 06:52:53.710916 (+ 2315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:53.710935 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:53.711397 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:53.711830 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:53.713209 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:53.715149 (+ 1940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:53.716682 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:53.717787 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:53.717938 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:53.721217 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:53.721225 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:53.721239 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:53.721279 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:53.724103 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:53.724835 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:53.724842 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:53.724847 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:53.725024 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:53.725436 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:53.725440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:53.725442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:53.725954 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:53.726136 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:53.726958 (+ 822us) server_negotiation.cc:299] Negotiation successful
0811 06:52:53.727363 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":269,"threads_started":1}
I20260811 06:52:53.731966 5111 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43075
I20260811 06:52:53.732355 5111 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:53.733320 5111 heartbeater.cc:511] Master 127.12.145.62:43075 requested a full tablet report, sending...
I20260811 06:52:53.736140 4769 ts_manager.cc:194] Registered new tserver with Master: c39ffa643a0845e39af4f07253d02e83 (127.12.145.1:44801)
I20260811 06:52:53.738395 4769 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:54681
W20260811 06:52:54.039755 5116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:54.040042 5116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:54.040148 5116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:54.047212 5116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:54.047314 5116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:54.047437 5116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:52:54.057238 5116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:33995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=37123
--tserver_master_addrs=127.12.145.62:43075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:54.058465 5116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:54.059707 5116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:54.072036 5123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:54.072103 5124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:54.072068 5127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:54.073101 5116 server_base.cc:1034] running on GCE node
I20260811 06:52:54.073840 5116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:54.074782 5116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:54.076020 5116 hybrid_clock.cc:648] HybridClock initialized: now 1786431174075944 us; error 53 us; skew 500 ppm
I20260811 06:52:54.076392 5116 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:54 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:54.079708 5116 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:52:54.081238 5116 webserver.cc:460] Webserver started at http://127.12.145.2:37123/ using document root <none> and password file <none>
I20260811 06:52:54.082031 5116 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:54.082178 5116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:54.087970 5116 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 06:52:54.090956 5137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:54.092373 5116 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:52:54.092541 5116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "4358a1e72e774dd9a53793ed190b76b4"
format_stamp: "Formatted at 2026-08-11 06:52:51 on dist-test-slave-7lbf"
server_key: "a71a1d62ba73c5e8c411779df5dae1db"
server_key_iv: "60b1b22d1236b039d3c16480e412451c"
server_key_version: "encryptionkey@0"
I20260811 06:52:54.093598 5116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:54.118191 5116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:54.122785 5116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:54.123065 5116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:54.124123 5116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:54.125623 5116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:54.125751 5116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:54.125874 5116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:54.125955 5116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:54.158695 5116 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:33995
I20260811 06:52:54.158758 5322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:33995 every 8 connection(s)
I20260811 06:52:54.160209 5116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:52:54.162971 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 5116
I20260811 06:52:54.163630 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:39279
--local_ip_for_outbound_sockets=127.12.145.3
--tserver_master_addrs=127.12.145.62:43075
--webserver_port=43641
--webserver_interface=127.12.145.3
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:52:54 dist-test-slave-7lbf krb5kdc[3771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:54.181267 5113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.163052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:60437 (local address 127.12.145.62:43075)
0811 06:52:54.163274 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.163279 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.164705 (+ 1426us) server_negotiation.cc:407] Connection header received
0811 06:52:54.166616 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.166623 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.166718 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.166857 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:54.168316 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.169367 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.170966 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.171576 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.171731 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.175389 (+ 3658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:54.175395 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:54.175398 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:54.175435 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:54.178209 (+ 2774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:54.178957 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:54.178961 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:54.178964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:54.179097 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:54.179528 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:54.179532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:54.179534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:54.179832 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:54.179970 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:54.180684 (+ 714us) server_negotiation.cc:299] Negotiation successful
0811 06:52:54.180921 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 06:52:54.182298 5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.163558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:60437)
0811 06:52:54.164510 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:54.164564 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:54.166329 (+ 1765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:54.167045 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:54.167054 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:54.167554 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:54.168124 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.168142 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.169538 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.169544 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.170798 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.170811 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.171805 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.171810 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.172023 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.172722 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:54.172749 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:54.175147 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:54.178366 (+ 3219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:54.178376 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:54.178393 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:54.178829 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:54.179206 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:54.179211 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:54.179216 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:54.179412 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:54.179962 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:54.179969 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:54.180309 (+ 340us) client_negotiation.cc:769] Sending connection context
0811 06:52:54.180548 (+ 239us) client_negotiation.cc:240] Negotiation successful
0811 06:52:54.181095 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":474,"threads_started":1}
I20260811 06:52:54.183668 5324 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43075
I20260811 06:52:54.183976 5324 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:54.184768 5324 heartbeater.cc:511] Master 127.12.145.62:43075 requested a full tablet report, sending...
I20260811 06:52:54.186220 4769 ts_manager.cc:194] Registered new tserver with Master: 4358a1e72e774dd9a53793ed190b76b4 (127.12.145.2:33995)
I20260811 06:52:54.187013 4769 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:60437
W20260811 06:52:54.493543 5330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:54.493824 5330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:54.493963 5330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:54.501070 5330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:54.501183 5330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:54.501341 5330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:52:54.510618 5330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:39279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=43641
--tserver_master_addrs=127.12.145.62:43075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:54.511866 5330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:54.513146 5330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:54.525779 5335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:54.525810 5339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:54.525868 5336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:54.527053 5330 server_base.cc:1034] running on GCE node
I20260811 06:52:54.527657 5330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:54.528564 5330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:54.529742 5330 hybrid_clock.cc:648] HybridClock initialized: now 1786431174529662 us; error 71 us; skew 500 ppm
I20260811 06:52:54.530036 5330 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:54 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:54.533131 5330 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:52:54.534675 5330 webserver.cc:460] Webserver started at http://127.12.145.3:43641/ using document root <none> and password file <none>
I20260811 06:52:54.535348 5330 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:54.535494 5330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:54.541021 5330 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 06:52:54.543758 5349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:54.545034 5330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 06:52:54.545192 5330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "f65ba86c7f04432e9b7f6171a7b919d4"
format_stamp: "Formatted at 2026-08-11 06:52:51 on dist-test-slave-7lbf"
server_key: "1b0585d20b3bafdcca92816aeb6b4f37"
server_key_iv: "d7c692291daf60cfb98122eb8b0177b6"
server_key_version: "encryptionkey@0"
I20260811 06:52:54.546200 5330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:54.590798 5330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:54.594867 5330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:54.595139 5330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:54.596145 5330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:54.597555 5330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:54.597654 5330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:54.597759 5330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:54.597836 5330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:54.628697 5330 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:39279
I20260811 06:52:54.628764 5551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:39279 every 8 connection(s)
I20260811 06:52:54.630184 5330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:52:54.632073 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 5330
Aug 11 06:52:54 dist-test-slave-7lbf krb5kdc[3771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431174, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:52:54.647568 5113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.632876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55960 (local address 127.12.145.62:43075)
0811 06:52:54.633051 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.633055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.633808 (+ 753us) server_negotiation.cc:407] Connection header received
0811 06:52:54.634042 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.634048 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.634133 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.634246 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:54.636250 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.637078 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.638752 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.639301 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.639437 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.642099 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:54.642105 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:54.642109 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:54.642141 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:54.644733 (+ 2592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:54.645418 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:54.645422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:54.645425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:54.645623 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:54.646025 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:54.646028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:54.646031 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:54.646406 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:54.646687 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:54.647002 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 06:52:54.647199 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":56}
I20260811 06:52:54.652005 5558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.632877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:54261 (local address 127.12.145.62:43075)
0811 06:52:54.633852 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.633858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.634615 (+ 757us) server_negotiation.cc:407] Connection header received
0811 06:52:54.636965 (+ 2350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.636970 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.637052 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.637143 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:54.638866 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.639755 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.641316 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.641794 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.641913 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.645304 (+ 3391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:54.645308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:54.645311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:54.645342 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:54.648758 (+ 3416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:54.649621 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:54.649625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:54.649627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:54.649743 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:54.650297 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:54.650301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:54.650303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:54.650583 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:54.650723 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:54.651399 (+ 676us) server_negotiation.cc:299] Negotiation successful
0811 06:52:54.651606 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":186,"server-negotiator.queue_time_us":853,"thread_start_us":574,"threads_started":1}
I20260811 06:52:54.652918 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.633589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:54261)
0811 06:52:54.634445 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:54.634496 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:54.636659 (+ 2163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:54.637426 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:54.637435 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:54.638083 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:52:54.638659 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.638677 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.639907 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.639911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.641175 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.641188 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.642036 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.642045 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.642272 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.642885 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:52:54.642917 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:52:54.645093 (+ 2176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:52:54.648905 (+ 3812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:54.648912 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:54.648924 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:54.649496 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:54.649908 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:52:54.649912 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:52:54.649916 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:52:54.650172 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:52:54.650712 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:52:54.650720 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:52:54.651054 (+ 334us) client_negotiation.cc:769] Sending connection context
0811 06:52:54.651284 (+ 230us) client_negotiation.cc:240] Negotiation successful
0811 06:52:54.651818 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":326,"threads_started":1}
I20260811 06:52:54.654302 5552 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43075
I20260811 06:52:54.654577 5552 heartbeater.cc:464] Registering TS with master...
I20260811 06:52:54.655249 5552 heartbeater.cc:511] Master 127.12.145.62:43075 requested a full tablet report, sending...
I20260811 06:52:54.656565 4769 ts_manager.cc:194] Registered new tserver with Master: f65ba86c7f04432e9b7f6171a7b919d4 (127.12.145.3:39279)
I20260811 06:52:54.657366 4769 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:54261
I20260811 06:52:54.662425 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:52:54.668998 5558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.663350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55966 (local address 127.12.145.62:43075)
0811 06:52:54.663509 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.663513 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.663982 (+ 469us) server_negotiation.cc:407] Connection header received
0811 06:52:54.664157 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.664161 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.664282 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.664397 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:52:54.664792 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.665447 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.666930 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.667350 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.667480 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.667963 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:52:54.668431 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:52:54.668570 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:54.668676 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 06:52:54.668755 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 06:52:54.669864 4769 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:55966:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:52:54.677057 4769 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:52:54.698551 5574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.689351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.0.0.1:46590)
0811 06:52:54.691070 (+ 1719us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:54.691089 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:54.691212 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:54.692272 (+ 1060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:54.692276 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:54.692301 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:54.692622 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.692633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.694248 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.694253 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.695744 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.695757 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.697405 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.697411 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.697622 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.697673 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 06:52:54.697806 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 06:52:54.697986 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1600,"thread_start_us":1471,"threads_started":1}
I20260811 06:52:54.698652 5569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.688184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:39279 (local address 127.0.0.1:56482)
0811 06:52:54.688933 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:54.688974 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:54.689150 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:54.691364 (+ 2214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:54.691368 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:54.691391 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:54.691762 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.691773 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.693790 (+ 2017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.693795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.696011 (+ 2216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.696026 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.697869 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.697876 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.698046 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.698077 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 06:52:54.698187 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 06:52:54.698301 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"mutex_wait_us":19,"thread_start_us":382,"threads_started":1}
I20260811 06:52:54.699156 5572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.688653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:33995 (local address 127.0.0.1:48792)
0811 06:52:54.690090 (+ 1437us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:54.690103 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:54.690215 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:54.691102 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:54.691109 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:54.691137 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:54.691565 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.691581 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.693506 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.693510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.696189 (+ 2679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.696202 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.698193 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.698200 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.698356 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.698398 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 06:52:54.698504 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 06:52:54.698647 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1333,"mutex_wait_us":641,"thread_start_us":618,"threads_started":1}
I20260811 06:52:54.699239 5571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.689052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48792 (local address 127.12.145.2:33995)
0811 06:52:54.689669 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.689678 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.690198 (+ 520us) server_negotiation.cc:407] Connection header received
0811 06:52:54.690352 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.690360 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.690619 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.690806 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:54.691781 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.693353 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.696365 (+ 3012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.697752 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.697872 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.698033 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:54.698759 (+ 726us) server_negotiation.cc:299] Negotiation successful
0811 06:52:54.698922 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":377,"threads_started":1}
I20260811 06:52:54.699294 5575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.690129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46590 (local address 127.12.145.1:44801)
0811 06:52:54.691710 (+ 1581us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.691718 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.691744 (+ 26us) server_negotiation.cc:407] Connection header received
0811 06:52:54.691830 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.691837 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.692067 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.692262 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:54.692829 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.694127 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.695901 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.697213 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.697338 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.697581 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:54.698801 (+ 1220us) server_negotiation.cc:299] Negotiation successful
0811 06:52:54.698968 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1441,"thread_start_us":1330,"threads_started":1}
I20260811 06:52:54.701702 5570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.688340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56482 (local address 127.12.145.3:39279)
0811 06:52:54.690798 (+ 2458us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.690806 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.690836 (+ 30us) server_negotiation.cc:407] Connection header received
0811 06:52:54.690933 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.690939 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.691140 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.691905 (+ 765us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:54.692105 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.693633 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.696198 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.697632 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.697764 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.697998 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:54.698243 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 06:52:54.698408 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2292,"thread_start_us":2137,"threads_started":1}
I20260811 06:52:54.701198 4999 tablet_service.cc:1467] Processing CreateTablet for tablet 596cd4c2d2844f9292084813c555a309 (DEFAULT_TABLE table=test-table [id=0cbd86cb7e2240408b7a88a74f847c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:52:54.702701 4999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 596cd4c2d2844f9292084813c555a309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:54.703027 5206 tablet_service.cc:1467] Processing CreateTablet for tablet 596cd4c2d2844f9292084813c555a309 (DEFAULT_TABLE table=test-table [id=0cbd86cb7e2240408b7a88a74f847c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:52:54.704358 5206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 596cd4c2d2844f9292084813c555a309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:54.704326 5432 tablet_service.cc:1467] Processing CreateTablet for tablet 596cd4c2d2844f9292084813c555a309 (DEFAULT_TABLE table=test-table [id=0cbd86cb7e2240408b7a88a74f847c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:52:54.705586 5432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 596cd4c2d2844f9292084813c555a309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:52:54.719376 5576 tablet_bootstrap.cc:492] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: Bootstrap starting.
I20260811 06:52:54.722195 5577 tablet_bootstrap.cc:492] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: Bootstrap starting.
I20260811 06:52:54.723011 5579 tablet_bootstrap.cc:492] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: Bootstrap starting.
I20260811 06:52:54.723855 5576 tablet_bootstrap.cc:654] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:54.724817 5576 log.cc:824] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:54.725900 5579 tablet_bootstrap.cc:654] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:54.727101 5579 log.cc:824] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:54.727910 5576 tablet_bootstrap.cc:492] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: No bootstrap required, opened a new log
I20260811 06:52:54.728148 5576 ts_tablet_manager.cc:1397] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260811 06:52:54.728399 5577 tablet_bootstrap.cc:654] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: Neither blocks nor log segments found. Creating new log.
I20260811 06:52:54.729287 5577 log.cc:824] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:54.730297 5579 tablet_bootstrap.cc:492] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: No bootstrap required, opened a new log
I20260811 06:52:54.730580 5579 ts_tablet_manager.cc:1397] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 06:52:54.731720 5577 tablet_bootstrap.cc:492] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: No bootstrap required, opened a new log
I20260811 06:52:54.731942 5577 ts_tablet_manager.cc:1397] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.003s
I20260811 06:52:54.738463 5576 raft_consensus.cc:348] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:54.738900 5576 raft_consensus.cc:374] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:54.739053 5576 raft_consensus.cc:729] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39ffa643a0845e39af4f07253d02e83, State: Initialized, Role: FOLLOWER
I20260811 06:52:54.739528 5577 raft_consensus.cc:348] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:54.739674 5576 consensus_queue.cc:260] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:54.739871 5577 raft_consensus.cc:374] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:54.739956 5577 raft_consensus.cc:729] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4358a1e72e774dd9a53793ed190b76b4, State: Initialized, Role: FOLLOWER
I20260811 06:52:54.740490 5577 consensus_queue.cc:260] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:54.740883 5111 heartbeater.cc:503] Master 127.12.145.62:43075 was elected leader, sending a full tablet report...
I20260811 06:52:54.741554 5576 ts_tablet_manager.cc:1428] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
I20260811 06:52:54.741557 5324 heartbeater.cc:503] Master 127.12.145.62:43075 was elected leader, sending a full tablet report...
I20260811 06:52:54.742177 5577 ts_tablet_manager.cc:1428] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: Time spent starting tablet: real 0.010s user 0.010s sys 0.001s
I20260811 06:52:54.740483 5579 raft_consensus.cc:348] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:54.742424 5579 raft_consensus.cc:374] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:52:54.742544 5579 raft_consensus.cc:729] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f65ba86c7f04432e9b7f6171a7b919d4, State: Initialized, Role: FOLLOWER
I20260811 06:52:54.743060 5579 consensus_queue.cc:260] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:54.744122 5552 heartbeater.cc:503] Master 127.12.145.62:43075 was elected leader, sending a full tablet report...
I20260811 06:52:54.744644 5579 ts_tablet_manager.cc:1428] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260811 06:52:54.873217 5591 raft_consensus.cc:482] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:52:54.873582 5591 raft_consensus.cc:504] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:54.875414 5591 leader_election.cc:288] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c39ffa643a0845e39af4f07253d02e83 (127.12.145.1:44801), 4358a1e72e774dd9a53793ed190b76b4 (127.12.145.2:33995)
I20260811 06:52:54.881415 5571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.876113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:34183 (local address 127.12.145.2:33995)
0811 06:52:54.876521 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.876527 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.876545 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:52:54.876622 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.876627 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.876707 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.876789 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:54.877327 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.878205 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.879813 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.880579 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.880728 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.880803 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:54.881047 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 06:52:54.881168 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249}
I20260811 06:52:54.881744 5575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.875909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:41405 (local address 127.12.145.1:44801)
0811 06:52:54.876098 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.876103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.876791 (+ 688us) server_negotiation.cc:407] Connection header received
0811 06:52:54.877026 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.877033 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.877110 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.877211 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:52:54.877758 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.878462 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.880125 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.880880 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.881017 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.881089 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:54.881364 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 06:52:54.881501 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 06:52:54.881421 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.875717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:33995 (local address 127.12.145.3:34183)
0811 06:52:54.876058 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:54.876080 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:54.876229 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:54.876977 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:54.876983 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:54.877010 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:54.877158 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.877166 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.878333 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.878337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.879647 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.879660 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.880728 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.880734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.880900 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.880926 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 06:52:54.881011 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 06:52:54.881155 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176}
W20260811 06:52:54.881752 5553 tablet.cc:2369] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:52:54.882189 5592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.875821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44801 (local address 127.12.145.3:41405)
0811 06:52:54.876673 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:54.876690 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:52:54.876821 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:52:54.877245 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:52:54.877249 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:52:54.877273 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:52:54.877612 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.877625 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.878610 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.878616 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.879970 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:52:54.879983 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.881073 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.881078 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:52:54.881223 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.881245 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 06:52:54.881332 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 06:52:54.881455 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"thread_start_us":438,"threads_started":1}
I20260811 06:52:54.882949 5243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "596cd4c2d2844f9292084813c555a309" candidate_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4358a1e72e774dd9a53793ed190b76b4" is_pre_election: true
I20260811 06:52:54.883193 5029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "596cd4c2d2844f9292084813c555a309" candidate_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39ffa643a0845e39af4f07253d02e83" is_pre_election: true
I20260811 06:52:54.883420 5243 raft_consensus.cc:2454] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f65ba86c7f04432e9b7f6171a7b919d4 in term 0.
I20260811 06:52:54.883652 5029 raft_consensus.cc:2454] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f65ba86c7f04432e9b7f6171a7b919d4 in term 0.
I20260811 06:52:54.884080 5358 leader_election.cc:302] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4358a1e72e774dd9a53793ed190b76b4, f65ba86c7f04432e9b7f6171a7b919d4; no voters:
I20260811 06:52:54.884482 5591 raft_consensus.cc:2781] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:52:54.884645 5591 raft_consensus.cc:482] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:52:54.884750 5591 raft_consensus.cc:3037] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:54.886940 5591 raft_consensus.cc:504] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:54.887559 5591 leader_election.cc:288] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [CANDIDATE]: Term 1 election: Requested vote from peers c39ffa643a0845e39af4f07253d02e83 (127.12.145.1:44801), 4358a1e72e774dd9a53793ed190b76b4 (127.12.145.2:33995)
I20260811 06:52:54.887955 5029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "596cd4c2d2844f9292084813c555a309" candidate_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39ffa643a0845e39af4f07253d02e83"
I20260811 06:52:54.888022 5243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "596cd4c2d2844f9292084813c555a309" candidate_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4358a1e72e774dd9a53793ed190b76b4"
I20260811 06:52:54.888198 5243 raft_consensus.cc:3037] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:54.888207 5029 raft_consensus.cc:3037] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:52:54.891398 5029 raft_consensus.cc:2454] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f65ba86c7f04432e9b7f6171a7b919d4 in term 1.
I20260811 06:52:54.891399 5243 raft_consensus.cc:2454] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f65ba86c7f04432e9b7f6171a7b919d4 in term 1.
I20260811 06:52:54.891810 5353 leader_election.cc:302] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c39ffa643a0845e39af4f07253d02e83, f65ba86c7f04432e9b7f6171a7b919d4; no voters:
I20260811 06:52:54.892104 5591 raft_consensus.cc:2781] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:52:54.892539 5591 raft_consensus.cc:686] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 1 LEADER]: Becoming Leader. State: Replica: f65ba86c7f04432e9b7f6171a7b919d4, State: Running, Role: LEADER
I20260811 06:52:54.892978 5591 consensus_queue.cc:237] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } }
I20260811 06:52:54.897608 4764 catalog_manager.cc:5495] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f65ba86c7f04432e9b7f6171a7b919d4 (127.12.145.3). New cstate: current_term: 1 leader_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f65ba86c7f04432e9b7f6171a7b919d4" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 } health_report { overall_health: UNKNOWN } } }
W20260811 06:52:54.912233 5325 tablet.cc:2369] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:52:54.934403 5570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.929304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56498 (local address 127.12.145.3:39279)
0811 06:52:54.929475 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.929479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.929496 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:52:54.929718 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.929722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.929811 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.929947 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:52:54.930230 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.931012 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.932360 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.932728 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.932817 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.933213 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:52:54.933826 (+ 613us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:52:54.933947 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:54.934083 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 06:52:54.934164 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:52:54.942562 5243 raft_consensus.cc:1261] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4 [term 1 FOLLOWER]: Refusing update from remote peer f65ba86c7f04432e9b7f6171a7b919d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:52:54.942564 5029 raft_consensus.cc:1261] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83 [term 1 FOLLOWER]: Refusing update from remote peer f65ba86c7f04432e9b7f6171a7b919d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:52:54.943629 5593 consensus_queue.cc:1035] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4358a1e72e774dd9a53793ed190b76b4" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 33995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:52:54.943960 5591 consensus_queue.cc:1035] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39ffa643a0845e39af4f07253d02e83" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:52:54.955632 5596 mvcc.cc:205] Tried to move back new op lower bound from 7317222092553854976 to 7317222092365414400. Current Snapshot: MvccSnapshot[applied={T|T < 7317222092553854976}]
I20260811 06:52:54.957715 5600 mvcc.cc:205] Tried to move back new op lower bound from 7317222092553854976 to 7317222092365414400. Current Snapshot: MvccSnapshot[applied={T|T < 7317222092553854976}]
I20260811 06:52:54.974128 4769 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:55966:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:52:54.974387 4769 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:55966:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:52:54.977669 4769 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Sending DeleteTablet for 3 replicas of tablet 596cd4c2d2844f9292084813c555a309
I20260811 06:52:54.979004 5432 tablet_service.cc:1514] Processing DeleteTablet for tablet 596cd4c2d2844f9292084813c555a309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:52:54 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:56482
I20260811 06:52:54.979012 4999 tablet_service.cc:1514] Processing DeleteTablet for tablet 596cd4c2d2844f9292084813c555a309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:52:54 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:46590
I20260811 06:52:54.979048 5206 tablet_service.cc:1514] Processing DeleteTablet for tablet 596cd4c2d2844f9292084813c555a309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:52:54 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:48792
I20260811 06:52:54.980351 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 4846
I20260811 06:52:54.991371 5615 tablet_replica.cc:330] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: stopping tablet replica
I20260811 06:52:54.991354 5619 tablet_replica.cc:330] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: stopping tablet replica
I20260811 06:52:54.991829 5615 raft_consensus.cc:2229] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:52:54.991820 5619 raft_consensus.cc:2229] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:52:54.992359 5619 raft_consensus.cc:2258] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:52:54.992508 5615 raft_consensus.cc:2258] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:52:54.993692 5618 tablet_replica.cc:330] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: stopping tablet replica
I20260811 06:52:54.995440 5615 ts_tablet_manager.cc:1905] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:52:54.995980 5618 raft_consensus.cc:2229] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:52:54.997556 5619 ts_tablet_manager.cc:1905] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:52:54.997663 5618 raft_consensus.cc:2258] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:52:54.999586 5618 ts_tablet_manager.cc:1905] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:52:55.004591 5619 ts_tablet_manager.cc:1918] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:52:55.004820 5619 log.cc:1196] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/596cd4c2d2844f9292084813c555a309
I20260811 06:52:55.005458 5619 ts_tablet_manager.cc:1939] T 596cd4c2d2844f9292084813c555a309 P 4358a1e72e774dd9a53793ed190b76b4: Deleting consensus metadata
I20260811 06:52:55.006596 5618 ts_tablet_manager.cc:1918] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:52:55.006829 5618 log.cc:1196] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/596cd4c2d2844f9292084813c555a309
I20260811 06:52:55.007413 5618 ts_tablet_manager.cc:1939] T 596cd4c2d2844f9292084813c555a309 P c39ffa643a0845e39af4f07253d02e83: Deleting consensus metadata
I20260811 06:52:55.007872 5575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:54.981919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46606 (local address 127.12.145.1:44801)
0811 06:52:54.982098 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:54.982104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:54.982123 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:52:54.982177 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:54.982183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:54.982258 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:54.982353 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:54.984455 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.985771 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.987875 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:54.988544 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:54.988665 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:54.996485 (+ 7820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:54.996501 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:54.996520 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:54.996571 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:55.003254 (+ 6683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:55.004296 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:55.004306 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:55.004310 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:55.004491 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:55.005034 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:55.005039 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:55.005042 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:55.005588 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:55.005918 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:55.007192 (+ 1274us) server_negotiation.cc:299] Negotiation successful
0811 06:52:55.007488 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 06:52:55.007965 4749 catalog_manager.cc:4841] TS 4358a1e72e774dd9a53793ed190b76b4 (127.12.145.2:33995): tablet 596cd4c2d2844f9292084813c555a309 (table test-table [id=0cbd86cb7e2240408b7a88a74f847c5a]) successfully deleted
I20260811 06:52:55.008869 5104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:55.009209 4745 catalog_manager.cc:4841] TS c39ffa643a0845e39af4f07253d02e83 (127.12.145.1:44801): tablet 596cd4c2d2844f9292084813c555a309 (table test-table [id=0cbd86cb7e2240408b7a88a74f847c5a]) successfully deleted
I20260811 06:52:55.013055 5615 ts_tablet_manager.cc:1918] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:52:55.013237 5615 log.cc:1196] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/596cd4c2d2844f9292084813c555a309
I20260811 06:52:55.013952 5615 ts_tablet_manager.cc:1939] T 596cd4c2d2844f9292084813c555a309 P f65ba86c7f04432e9b7f6171a7b919d4: Deleting consensus metadata
I20260811 06:52:55.016549 4745 catalog_manager.cc:4841] TS f65ba86c7f04432e9b7f6171a7b919d4 (127.12.145.3:39279): tablet 596cd4c2d2844f9292084813c555a309 (table test-table [id=0cbd86cb7e2240408b7a88a74f847c5a]) successfully deleted
I20260811 06:52:55.103972 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 4846
I20260811 06:52:55.134814 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 5116
I20260811 06:52:55.150453 5571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:55.135636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48798 (local address 127.12.145.2:33995)
0811 06:52:55.135798 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:55.135803 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:55.135821 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:52:55.136052 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:55.136057 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:55.136137 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:55.136227 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:55.138024 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:55.138877 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:55.140778 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:55.141205 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:55.141300 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:55.144824 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:55.144839 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:55.144855 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:55.144892 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:55.147709 (+ 2817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:55.148510 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:55.148518 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:55.148520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:55.148652 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:55.149017 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:55.149020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:55.149022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:55.149403 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:55.149769 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:55.150001 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 06:52:55.150171 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 06:52:55.151274 5316 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:55.253472 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 5116
I20260811 06:52:55.276754 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 5330
I20260811 06:52:55.293272 5570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:55.277647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56500 (local address 127.12.145.3:39279)
0811 06:52:55.277863 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 06:52:55.277869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:52:55.277894 (+ 25us) server_negotiation.cc:407] Connection header received
0811 06:52:55.278048 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:52:55.278054 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:52:55.278194 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:52:55.278316 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:52:55.280043 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:55.281253 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:55.282728 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:52:55.283393 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:52:55.283539 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:52:55.286091 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:52:55.286110 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:52:55.286131 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:52:55.286185 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:52:55.290274 (+ 4089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:55.291018 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:55.291029 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:55.291032 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:55.291244 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:52:55.291586 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:52:55.291591 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:52:55.291594 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:52:55.292082 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:52:55.292421 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 06:52:55.292613 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 06:52:55.292852 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 06:52:55.294106 5541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:55.418030 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 5330
I20260811 06:52:55.445734 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 4716
I20260811 06:52:55.446879 4821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:52:55.558941 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 4716
I20260811 06:52:55.587384 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43075
--webserver_interface=127.12.145.62
--webserver_port=43137
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:43075
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:55.918085 5626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:55.918360 5626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:55.918450 5626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:55.925449 5626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:52:55.925577 5626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:55.925642 5626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:55.925706 5626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:52:55.925750 5626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:52:55.935261 5626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:43075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=43137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:55.936542 5626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:55.937832 5626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:55.949049 5640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:55.949106 5637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:55.949131 5638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:55.950242 5626 server_base.cc:1034] running on GCE node
I20260811 06:52:55.951012 5626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:55.952311 5626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:55.953572 5626 hybrid_clock.cc:648] HybridClock initialized: now 1786431175953486 us; error 42 us; skew 500 ppm
I20260811 06:52:55.953929 5626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:55 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431175, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:55.956928 5626 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:52:55.958396 5626 webserver.cc:460] Webserver started at http://127.12.145.62:43137/ using document root <none> and password file <none>
I20260811 06:52:55.959055 5626 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:55.959177 5626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:55.964500 5626 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 06:52:55.967286 5653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:55.968514 5626 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:52:55.968668 5626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "192e5450f2644d3d9e286c61b47c7611"
format_stamp: "Formatted at 2026-08-11 06:52:50 on dist-test-slave-7lbf"
server_key: "0cfcb5804c5683caebc695c3c1ae908a"
server_key_iv: "bf61b96cf7881dbe56d470fe62ce89b6"
server_key_version: "encryptionkey@0"
I20260811 06:52:55.969647 5626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:55.989658 5626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:55.993291 5626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:55.993551 5626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:56.012236 5626 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:43075
I20260811 06:52:56.012300 5743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:43075 every 8 connection(s)
I20260811 06:52:56.013962 5626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:52:56.020634 5745 sys_catalog.cc:263] Verifying existing consensus state
I20260811 06:52:56.022722 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 5626
I20260811 06:52:56.023731 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:44801
--local_ip_for_outbound_sockets=127.12.145.1
--tserver_master_addrs=127.12.145.62:43075
--webserver_port=34107
--webserver_interface=127.12.145.1
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:52:56.024582 5745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Bootstrap starting.
I20260811 06:52:56.047179 5745 log.cc:824] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Log is configured to *not* fsync() on all Append() calls
I20260811 06:52:56.063323 5745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 06:52:56.063829 5745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611: Bootstrap complete.
I20260811 06:52:56.072677 5745 raft_consensus.cc:348] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:56.073572 5745 raft_consensus.cc:729] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192e5450f2644d3d9e286c61b47c7611, State: Initialized, Role: FOLLOWER
I20260811 06:52:56.074159 5745 consensus_queue.cc:260] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:56.074369 5745 raft_consensus.cc:388] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:52:56.074486 5745 raft_consensus.cc:482] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:52:56.074640 5745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 2 FOLLOWER]: Advancing to term 3
I20260811 06:52:56.078444 5745 raft_consensus.cc:504] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:56.078923 5745 leader_election.cc:302] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 192e5450f2644d3d9e286c61b47c7611; no voters:
I20260811 06:52:56.079550 5745 leader_election.cc:288] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 06:52:56.079684 5752 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 06:52:56.080794 5752 raft_consensus.cc:686] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [term 3 LEADER]: Becoming Leader. State: Replica: 192e5450f2644d3d9e286c61b47c7611, State: Running, Role: LEADER
I20260811 06:52:56.081409 5752 consensus_queue.cc:237] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } }
I20260811 06:52:56.081727 5745 sys_catalog.cc:564] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:52:56.083853 5755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 192e5450f2644d3d9e286c61b47c7611. Latest consensus state: current_term: 3 leader_uuid: "192e5450f2644d3d9e286c61b47c7611" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } } }
I20260811 06:52:56.084249 5755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:56.084816 5753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "192e5450f2644d3d9e286c61b47c7611" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "192e5450f2644d3d9e286c61b47c7611" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43075 } } }
I20260811 06:52:56.085111 5753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 192e5450f2644d3d9e286c61b47c7611 [sys.catalog]: This master's current role is: LEADER
I20260811 06:52:56.090165 5770 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:52:56.098527 5770 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:52:56.100090 5770 catalog_manager.cc:1259] Loaded cluster ID: 8f46b86b48904d75bfd8cf3f55d63601
I20260811 06:52:56.100261 5770 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 06:52:56.102634 5770 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fee98e869ad google::LogMessage::Fail() at ??:0
@ 0x7fee98e8988a google::LogMessage::SendToLog() at ??:0
@ 0x7fee98e864de google::LogMessage::Flush() at ??:0
@ 0x7fee98e87a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7feeae8b9512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7feeae8b6976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7feeae93e610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7feeae93e439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fee9bad2345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fee9bad591c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fee9bad5799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fee9bab0eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fee9ed8a6db start_thread at ??:0
@ 0x7fee97d2061f clone at ??:0
W20260811 06:52:56.438907 5748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:56.439178 5748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:56.439308 5748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:56.446466 5748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:56.446575 5748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:56.446728 5748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:52:56.456245 5748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:44801
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=34107
--tserver_master_addrs=127.12.145.62:43075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:56.457504 5748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:56.458796 5748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:56.471356 5816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:56.471292 5817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:56.471398 5820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:56.472185 5748 server_base.cc:1034] running on GCE node
I20260811 06:52:56.472783 5748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:56.473685 5748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:56.474918 5748 hybrid_clock.cc:648] HybridClock initialized: now 1786431176474871 us; error 40 us; skew 500 ppm
I20260811 06:52:56.475207 5748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:56 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431176, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:56.478236 5748 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:52:56.479627 5748 webserver.cc:460] Webserver started at http://127.12.145.1:34107/ using document root <none> and password file <none>
I20260811 06:52:56.480294 5748 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:56.480429 5748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:56.485687 5748 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260811 06:52:56.488364 5836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:56.489711 5748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:52:56.489902 5748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "c39ffa643a0845e39af4f07253d02e83"
format_stamp: "Formatted at 2026-08-11 06:52:50 on dist-test-slave-7lbf"
server_key: "eab1f644bb3099ad663f901118e6c8f9"
server_key_iv: "3c41080cff84d9f7037ef7530aaf1c4d"
server_key_version: "encryptionkey@0"
I20260811 06:52:56.490854 5748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:56.508500 5748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:56.512694 5748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:56.512952 5748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:56.513933 5748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:56.515214 5748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:56.515313 5748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:56.515424 5748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:56.515501 5748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:56.546939 5748 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:44801
I20260811 06:52:56.547009 6012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:44801 every 8 connection(s)
I20260811 06:52:56.548398 5748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:52:56.553140 6017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:56.551302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:51915)
0811 06:52:56.552038 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:56.552264 (+ 226us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":285,"threads_started":1}
I20260811 06:52:56.553277 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 5748
W20260811 06:52:56.553884 6013 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:43075 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.62:43075: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
I20260811 06:52:56.553942 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:33995
--local_ip_for_outbound_sockets=127.12.145.2
--tserver_master_addrs=127.12.145.62:43075
--webserver_port=37123
--webserver_interface=127.12.145.2
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:52:56.554708 6017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:56.554364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:50471)
0811 06:52:56.554518 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:56.554588 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 06:52:56.555536 6017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:56.555210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:52787)
0811 06:52:56.555349 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:56.555423 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 06:52:56.555770 6013 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 06:52:56.892791 6018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:56.893096 6018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:56.893236 6018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:56.900815 6018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:56.900934 6018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:56.901110 6018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:52:56.911113 6018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:33995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=37123
--tserver_master_addrs=127.12.145.62:43075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:56.912438 6018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:56.913796 6018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:56.926604 6027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:56.926575 6035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:56.926582 6029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:56.927743 6018 server_base.cc:1034] running on GCE node
I20260811 06:52:56.928362 6018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:56.929248 6018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:56.930439 6018 hybrid_clock.cc:648] HybridClock initialized: now 1786431176930399 us; error 34 us; skew 500 ppm
I20260811 06:52:56.930748 6018 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:56 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431176, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:56.933810 6018 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:52:56.935271 6018 webserver.cc:460] Webserver started at http://127.12.145.2:37123/ using document root <none> and password file <none>
I20260811 06:52:56.935904 6018 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:56.936019 6018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:56.941239 6018 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:52:56.943861 6050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:56.945092 6018 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 06:52:56.945242 6018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "4358a1e72e774dd9a53793ed190b76b4"
format_stamp: "Formatted at 2026-08-11 06:52:51 on dist-test-slave-7lbf"
server_key: "a71a1d62ba73c5e8c411779df5dae1db"
server_key_iv: "60b1b22d1236b039d3c16480e412451c"
server_key_version: "encryptionkey@0"
I20260811 06:52:56.946257 6018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:56.966272 6018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:56.970193 6018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:56.970436 6018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:56.971341 6018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:56.972612 6018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:56.972712 6018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:56.972836 6018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:56.972906 6018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:57.004034 6018 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:33995
I20260811 06:52:57.004099 6234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:33995 every 8 connection(s)
I20260811 06:52:57.005461 6018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:52:57.010255 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:57.008442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:34579)
0811 06:52:57.009138 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:57.009355 (+ 217us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":271,"threads_started":1}
W20260811 06:52:57.011000 6235 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:43075 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.62:43075: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
I20260811 06:52:57.011816 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:57.011490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:35349)
0811 06:52:57.011640 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:57.011709 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 06:52:57.012619 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:57.012294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:60225)
0811 06:52:57.012428 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:57.012510 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 06:52:57.012853 6235 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 06:52:57.015851 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 6018
I20260811 06:52:57.016455 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:39279
--local_ip_for_outbound_sockets=127.12.145.3
--tserver_master_addrs=127.12.145.62:43075
--webserver_port=43641
--webserver_interface=127.12.145.3
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:52:57.339089 6242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:52:57.339390 6242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:52:57.339526 6242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:52:57.346623 6242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:52:57.346745 6242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:52:57.346895 6242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:52:57.356459 6242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:39279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=43641
--tserver_master_addrs=127.12.145.62:43075
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:52:57.357784 6242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:52:57.359063 6242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:52:57.371621 6256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:57.371812 6252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:52:57.371742 6250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:52:57.372685 6242 server_base.cc:1034] running on GCE node
I20260811 06:52:57.373266 6242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:52:57.374274 6242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:52:57.375488 6242 hybrid_clock.cc:648] HybridClock initialized: now 1786431177375436 us; error 61 us; skew 500 ppm
I20260811 06:52:57.375806 6242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:52:57 dist-test-slave-7lbf krb5kdc[3771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431177, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:52:57.379076 6242 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:52:57.380506 6242 webserver.cc:460] Webserver started at http://127.12.145.3:43641/ using document root <none> and password file <none>
I20260811 06:52:57.381192 6242 fs_manager.cc:359] Metadata directory not provided
I20260811 06:52:57.381299 6242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:52:57.386694 6242 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:52:57.389412 6267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:57.390810 6242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:52:57.391009 6242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "f65ba86c7f04432e9b7f6171a7b919d4"
format_stamp: "Formatted at 2026-08-11 06:52:51 on dist-test-slave-7lbf"
server_key: "1b0585d20b3bafdcca92816aeb6b4f37"
server_key_iv: "d7c692291daf60cfb98122eb8b0177b6"
server_key_version: "encryptionkey@0"
I20260811 06:52:57.391993 6242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:52:57.407963 6242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:52:57.411657 6242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:52:57.411907 6242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:52:57.412815 6242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:52:57.414170 6242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:52:57.414271 6242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:57.414381 6242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:52:57.414461 6242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:52:57.444106 6242 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:39279
I20260811 06:52:57.444161 6461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:39279 every 8 connection(s)
I20260811 06:52:57.445500 6242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:52:57.450361 6468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:57.448351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:51247)
0811 06:52:57.449166 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:57.449381 (+ 215us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":275,"threads_started":1}
W20260811 06:52:57.451104 6463 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:43075 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.62:43075: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
I20260811 06:52:57.451933 6468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:57.451552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:39597)
0811 06:52:57.451714 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:57.451797 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 06:52:57.451941 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 6242
I20260811 06:52:57.452719 6468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:57.452410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:36921)
0811 06:52:57.452542 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:57.452617 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 06:52:57.452945 6463 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 06:52:57.557219 6470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:57.556292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:52659)
0811 06:52:57.556826 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:57.556963 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":236,"threads_started":1}
I20260811 06:52:58.014153 6473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:58.013332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:50247)
0811 06:52:58.013815 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:58.013934 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":247,"threads_started":1}
I20260811 06:52:58.454293 6475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:58.453444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:45843)
0811 06:52:58.453944 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:58.454063 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":251,"threads_started":1}
I20260811 06:52:58.558853 6476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:58.558067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:36889)
0811 06:52:58.558569 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:58.558655 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":261,"threads_started":1}
I20260811 06:52:59.015731 6481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:59.014963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:45557)
0811 06:52:59.015475 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:59.015558 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":244,"threads_started":1}
I20260811 06:52:59.455847 6482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:59.455156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:54757)
0811 06:52:59.455597 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:59.455678 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":211,"threads_started":1}
I20260811 06:52:59.560521 6484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:52:59.559777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:58535)
0811 06:52:59.560233 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0811 06:52:59.560323 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":228,"threads_started":1}
I20260811 06:53:00.017284 6485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:00.016563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:52199)
0811 06:53:00.017032 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:00.017117 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":259,"threads_started":1}
I20260811 06:53:00.457543 6486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:00.456691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:59913)
0811 06:53:00.457236 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:00.457339 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":292,"threads_started":1}
I20260811 06:53:00.562110 6489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:00.561328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:41387)
0811 06:53:00.561831 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:00.561916 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":274,"threads_started":1}
I20260811 06:53:01.018939 6490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:01.018154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:49953)
0811 06:53:01.018617 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:01.018701 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":237,"threads_started":1}
I20260811 06:53:01.459195 6491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:01.458406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:41595)
0811 06:53:01.458898 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:01.458985 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":249,"threads_started":1}
I20260811 06:53:01.563776 6492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:01.562947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:35757)
0811 06:53:01.563501 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:01.563594 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":273,"threads_started":1}
I20260811 06:53:02.020573 6493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:02.019834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:57625)
0811 06:53:02.020307 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:02.020393 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":229,"threads_started":1}
I20260811 06:53:02.460757 6494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:02.460051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:53691)
0811 06:53:02.460507 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:02.460590 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":231,"threads_started":1}
I20260811 06:53:02.565495 6497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:02.564651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:51821)
0811 06:53:02.565193 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:02.565312 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":274,"threads_started":1}
I20260811 06:53:03.022269 6500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:03.021486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:41209)
0811 06:53:03.022009 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:03.022105 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":245,"threads_started":1}
I20260811 06:53:03.462356 6503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:03.461659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:33871)
0811 06:53:03.462094 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:03.462187 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":210,"threads_started":1}
I20260811 06:53:03.567353 6507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:03.566505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:55033)
0811 06:53:03.567036 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:03.567123 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":216,"threads_started":1}
I20260811 06:53:04.024315 6508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:04.023296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:38373)
0811 06:53:04.023984 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:04.024078 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":259,"threads_started":1}
I20260811 06:53:04.464344 6510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:04.463470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:37543)
0811 06:53:04.464030 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:04.464121 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":275,"threads_started":1}
I20260811 06:53:04.569012 6512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:04.568288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:40587)
0811 06:53:04.568749 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:04.568841 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":231,"threads_started":1}
I20260811 06:53:05.026209 6514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:05.025423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:48345)
0811 06:53:05.025954 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:05.026042 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":292,"threads_started":1}
I20260811 06:53:05.465981 6518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:05.465259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:33883)
0811 06:53:05.465723 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:05.465803 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":242,"threads_started":1}
I20260811 06:53:05.570762 6519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:05.569929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:40115)
0811 06:53:05.570474 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:05.570578 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":261,"threads_started":1}
I20260811 06:53:06.027817 6520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:06.027087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:55193)
0811 06:53:06.027557 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:06.027642 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":219,"threads_started":1}
I20260811 06:53:06.467698 6522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:06.466863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:33933)
0811 06:53:06.467413 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:06.467515 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":298,"threads_started":1}
I20260811 06:53:06.572305 6523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:06.571606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:48159)
0811 06:53:06.572061 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:06.572146 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":238,"threads_started":1}
I20260811 06:53:07.029385 6524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:07.028714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:47937)
0811 06:53:07.029144 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:07.029224 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":226,"threads_started":1}
I20260811 06:53:07.469349 6528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:07.468634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:44419)
0811 06:53:07.469097 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:07.469181 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":245,"threads_started":1}
I20260811 06:53:07.573920 6529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:07.573101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:43197)
0811 06:53:07.573626 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:07.573728 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":253,"threads_started":1}
I20260811 06:53:08.031038 6530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:08.030287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:42661)
0811 06:53:08.030742 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:08.030861 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":234,"threads_started":1}
I20260811 06:53:08.470993 6532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:08.470246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:41015)
0811 06:53:08.470721 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:08.470813 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":233,"threads_started":1}
I20260811 06:53:08.575558 6533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:08.574853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:37051)
0811 06:53:08.575307 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:08.575394 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":222,"threads_started":1}
I20260811 06:53:09.032582 6536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:09.031917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:44669)
0811 06:53:09.032338 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:09.032421 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":211,"threads_started":1}
I20260811 06:53:09.472584 6537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:09.471871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:49903)
0811 06:53:09.472324 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:09.472408 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":240,"threads_started":1}
I20260811 06:53:09.577298 6538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:09.576435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:60185)
0811 06:53:09.576975 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:09.577076 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":253,"threads_started":1}
I20260811 06:53:10.034283 6541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:10.033468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:44699)
0811 06:53:10.033995 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:10.034092 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":258,"threads_started":1}
I20260811 06:53:10.474504 6543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:10.473556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:50867)
0811 06:53:10.474159 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:10.474263 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":284,"threads_started":1}
I20260811 06:53:10.578915 6546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:10.578204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:37307)
0811 06:53:10.578648 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:10.578732 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":219,"threads_started":1}
I20260811 06:53:11.035884 6548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:11.035161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:34505)
0811 06:53:11.035616 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:11.035700 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":233,"threads_started":1}
I20260811 06:53:11.476127 6549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:11.475378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:33227)
0811 06:53:11.475841 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:11.475937 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":229,"threads_started":1}
I20260811 06:53:11.580776 6550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:11.580045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.1:46121)
0811 06:53:11.580499 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:11.580590 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":234,"threads_started":1}
I20260811 06:53:12.037806 6551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:12.036986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.2:34689)
0811 06:53:12.037461 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:12.037591 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":257,"threads_started":1}
I20260811 06:53:12.460688 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 5748
I20260811 06:53:12.478181 6555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:12.477282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43075 (local address 127.12.145.3:47089)
0811 06:53:12.477880 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:12.477992 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:43075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":282,"threads_started":1}
I20260811 06:53:12.478505 6552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:12.461937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48958 (local address 127.12.145.1:44801)
0811 06:53:12.462520 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:12.462534 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:12.462571 (+ 37us) server_negotiation.cc:407] Connection header received
0811 06:53:12.464113 (+ 1542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:12.464123 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:12.464551 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:12.464886 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:12.466477 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:12.467697 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:12.468900 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:12.469598 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:12.469769 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:12.472386 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:12.472394 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:12.472409 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:12.472446 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:12.475193 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:12.475867 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:12.475874 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:12.475881 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:12.476059 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:12.476439 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:12.476443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:12.476445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:12.476969 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:12.477284 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:12.477755 (+ 471us) server_negotiation.cc:299] Negotiation successful
0811 06:53:12.478169 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":272,"threads_started":1}
I20260811 06:53:12.479833 6007 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:12.565761 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 5748
I20260811 06:53:12.592020 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 6018
I20260811 06:53:12.610643 6557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:12.592924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49322 (local address 127.12.145.2:33995)
0811 06:53:12.593495 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:12.593509 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:12.593576 (+ 67us) server_negotiation.cc:407] Connection header received
0811 06:53:12.595153 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:12.595166 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:12.595606 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:12.595956 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:12.597674 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:12.598964 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:12.600397 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:12.601118 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:12.601333 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:12.604130 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:12.604140 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:12.604155 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:12.604195 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:12.607190 (+ 2995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:12.607907 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:12.607914 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:12.607921 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:12.608107 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:12.608527 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:12.608533 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:12.608535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:12.609065 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:12.609389 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:12.609882 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 06:53:12.610318 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":245,"threads_started":1}
I20260811 06:53:12.612043 6227 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:12.693801 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 6018
I20260811 06:53:12.720510 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 6242
I20260811 06:53:12.738099 6560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:12.721508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39390 (local address 127.12.145.3:39279)
0811 06:53:12.722154 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:12.722169 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:12.722210 (+ 41us) server_negotiation.cc:407] Connection header received
0811 06:53:12.723852 (+ 1642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:12.723860 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:12.724277 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:12.724601 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:12.726189 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:12.727380 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:12.728672 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:12.729307 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:12.729481 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:12.732193 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:12.732201 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:12.732214 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:12.732251 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:12.735072 (+ 2821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:12.735738 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:12.735745 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:12.735751 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:12.735966 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:12.736248 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:12.736251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:12.736253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:12.736752 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:12.737026 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:12.737337 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 06:53:12.737755 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":286,"threads_started":1}
I20260811 06:53:12.739449 6456 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:12.823559 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 6242
2026-08-11T06:53:12Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24693 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:53:12 dist-test-slave-7lbf krb5kdc[6567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:53:12 dist-test-slave-7lbf krb5kdc[6567](info): set up 2 sockets
Aug 11 06:53:12 dist-test-slave-7lbf krb5kdc[6567](info): commencing operation
krb5kdc: starting...
W20260811 06:53:14.093943 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.001s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:53:14 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:53:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:53:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:53:14.369438 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35133
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:35133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:53:14.698992 6587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:53:14.699307 6587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:53:14.699445 6587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:53:14.706672 6587 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 06:53:14.706780 6587 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 06:53:14.706836 6587 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 06:53:14.706909 6587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:53:14.706992 6587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:53:14.707090 6587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:53:14.707154 6587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:53:14.707230 6587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:53:14.716949 6587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:35133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:53:14.718226 6587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:53:14.719542 6587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:53:14.730846 6597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:14.730994 6598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:14.731001 6601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:53:14.731841 6587 server_base.cc:1034] running on GCE node
I20260811 06:53:14.732540 6587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:53:14.733868 6587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:53:14.735073 6587 hybrid_clock.cc:648] HybridClock initialized: now 1786431194735010 us; error 35 us; skew 500 ppm
I20260811 06:53:14.735406 6587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:53:14 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431194, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:53:14.738390 6587 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:53:14.739796 6587 webserver.cc:460] Webserver started at http://127.12.145.62:33359/ using document root <none> and password file <none>
I20260811 06:53:14.740468 6587 fs_manager.cc:359] Metadata directory not provided
I20260811 06:53:14.740564 6587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:53:14.740869 6587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:53:14.743829 6587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "8ff16d4aaf6041dc926361912f4911a3"
format_stamp: "Formatted at 2026-08-11 06:53:14 on dist-test-slave-7lbf"
server_key: "3c3dfac5cdbddd2c516bfde60eea0916"
server_key_iv: "3b88ac31adcaa4c91481ea381d711a3b"
server_key_version: "encryptionkey@0"
I20260811 06:53:14.744589 6587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "8ff16d4aaf6041dc926361912f4911a3"
format_stamp: "Formatted at 2026-08-11 06:53:14 on dist-test-slave-7lbf"
server_key: "3c3dfac5cdbddd2c516bfde60eea0916"
server_key_iv: "3b88ac31adcaa4c91481ea381d711a3b"
server_key_version: "encryptionkey@0"
I20260811 06:53:14.749608 6587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 06:53:14.752952 6611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:14.754246 6587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:53:14.754398 6587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "8ff16d4aaf6041dc926361912f4911a3"
format_stamp: "Formatted at 2026-08-11 06:53:14 on dist-test-slave-7lbf"
server_key: "3c3dfac5cdbddd2c516bfde60eea0916"
server_key_iv: "3b88ac31adcaa4c91481ea381d711a3b"
server_key_version: "encryptionkey@0"
I20260811 06:53:14.754596 6587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:53:14.770610 6587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:53:14.774487 6587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:53:14.774722 6587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:53:14.795127 6587 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:35133
I20260811 06:53:14.795154 6694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:35133 every 8 connection(s)
I20260811 06:53:14.796512 6587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:53:14.800231 6696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:53:14.804481 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 6587
I20260811 06:53:14.804690 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:53:14.805507 12868 external_mini_cluster.cc:1428] Setting key 1617d0efe797f7067b41d7cc24c0233c
I20260811 06:53:14.811839 6696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Bootstrap starting.
I20260811 06:53:14.815328 6696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Neither blocks nor log segments found. Creating new log.
I20260811 06:53:14.816488 6696 log.cc:824] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Log is configured to *not* fsync() on all Append() calls
I20260811 06:53:14.819665 6696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: No bootstrap required, opened a new log
Aug 11 06:53:14 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:53:14.827548 6696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:53:14.827960 6696 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:53:14.828079 6696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff16d4aaf6041dc926361912f4911a3, State: Initialized, Role: FOLLOWER
I20260811 06:53:14.828727 6703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:14.807559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58922 (local address 127.12.145.62:35133)
0811 06:53:14.808323 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:14.808338 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:14.808380 (+ 42us) server_negotiation.cc:407] Connection header received
0811 06:53:14.810369 (+ 1989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:14.810393 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:14.810755 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:14.811076 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:14.812824 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:14.814178 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:14.816025 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:14.816701 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:14.816821 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:14.821570 (+ 4749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:14.821579 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:14.821596 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:14.821641 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:14.824659 (+ 3018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:14.825319 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:14.825329 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:14.825335 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:14.825503 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:14.825909 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:14.825915 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:14.825920 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:14.826462 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:14.826747 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:14.827198 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 06:53:14.827574 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":359,"threads_started":1}
I20260811 06:53:14.828634 6696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:53:14.828877 6696 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:53:14.829044 6696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:53:14.829207 6696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:53:14.831578 6696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:53:14.832053 6696 leader_election.cc:302] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ff16d4aaf6041dc926361912f4911a3; no voters:
I20260811 06:53:14.832571 6696 leader_election.cc:288] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:53:14.832686 6705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:53:14.833297 6705 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 1 LEADER]: Becoming Leader. State: Replica: 8ff16d4aaf6041dc926361912f4911a3, State: Running, Role: LEADER
I20260811 06:53:14.833839 6705 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:53:14.834539 6696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:53:14.836385 6706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ff16d4aaf6041dc926361912f4911a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } } }
I20260811 06:53:14.836377 6707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ff16d4aaf6041dc926361912f4911a3. Latest consensus state: current_term: 1 leader_uuid: "8ff16d4aaf6041dc926361912f4911a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } } }
I20260811 06:53:14.836867 6707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: This master's current role is: LEADER
I20260811 06:53:14.836865 6706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: This master's current role is: LEADER
I20260811 06:53:14.837872 6711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:53:14.845049 6711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:53:14.854866 6711 catalog_manager.cc:1347] Generated new cluster ID: 51c7251711ad4f438c9387a3322baf1f
I20260811 06:53:14.854987 6711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:53:14.867066 6711 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:53:14.868391 6711 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:53:14.877085 6711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Generated new TSK 0
I20260811 06:53:14.877945 6711 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:53:14.958731 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35133
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:53:15.313634 6742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:53:15.313896 6742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:53:15.314033 6742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:53:15.320998 6742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:53:15.321099 6742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:53:15.321249 6742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:53:15.330758 6742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35133
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:53:15.332038 6742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:53:15.333316 6742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:53:15.346089 6748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:15.346024 6750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:15.346063 6752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:53:15.346801 6742 server_base.cc:1034] running on GCE node
I20260811 06:53:15.347404 6742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:53:15.348264 6742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:53:15.349474 6742 hybrid_clock.cc:648] HybridClock initialized: now 1786431195349419 us; error 48 us; skew 500 ppm
I20260811 06:53:15.349802 6742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:53:15 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431195, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:53:15.352829 6742 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:53:15.354249 6742 webserver.cc:460] Webserver started at http://127.12.145.1:37891/ using document root <none> and password file <none>
I20260811 06:53:15.354915 6742 fs_manager.cc:359] Metadata directory not provided
I20260811 06:53:15.355038 6742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:53:15.355321 6742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:53:15.358191 6742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "a8a77457629447fdac451d2f31e9c2be"
format_stamp: "Formatted at 2026-08-11 06:53:15 on dist-test-slave-7lbf"
server_key: "8b5bb5c65bafcef3de8ffaceee84187a"
server_key_iv: "ef1f4e08791a3e77f710b421caa5cfd1"
server_key_version: "encryptionkey@0"
I20260811 06:53:15.358960 6742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "a8a77457629447fdac451d2f31e9c2be"
format_stamp: "Formatted at 2026-08-11 06:53:15 on dist-test-slave-7lbf"
server_key: "8b5bb5c65bafcef3de8ffaceee84187a"
server_key_iv: "ef1f4e08791a3e77f710b421caa5cfd1"
server_key_version: "encryptionkey@0"
I20260811 06:53:15.364045 6742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:53:15.367293 6761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:15.368637 6742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 06:53:15.368791 6742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "a8a77457629447fdac451d2f31e9c2be"
format_stamp: "Formatted at 2026-08-11 06:53:15 on dist-test-slave-7lbf"
server_key: "8b5bb5c65bafcef3de8ffaceee84187a"
server_key_iv: "ef1f4e08791a3e77f710b421caa5cfd1"
server_key_version: "encryptionkey@0"
I20260811 06:53:15.368965 6742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:53:15.390137 6742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:53:15.394323 6742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:53:15.394604 6742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:53:15.395521 6742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:53:15.396813 6742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:53:15.396895 6742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:15.397006 6742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:53:15.397058 6742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:15.427059 6742 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:41413
I20260811 06:53:15.427122 6949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:41413 every 8 connection(s)
I20260811 06:53:15.428273 6742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:53:15.430050 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 6742
I20260811 06:53:15.430284 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:53:15.431022 12868 external_mini_cluster.cc:1428] Setting key a1719fec7185e4d9f4a5d0e4c4ae3250
Aug 11 06:53:15 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431195, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:53:15.449019 6954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:15.431344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:49759)
0811 06:53:15.432152 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:15.432195 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:15.434091 (+ 1896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:15.434720 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:15.434728 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:15.435258 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:53:15.435802 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:15.435820 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:15.437117 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:15.437120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:15.438359 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:15.438372 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:15.439225 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:15.439229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:15.439416 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:15.440008 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:53:15.440035 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:53:15.442311 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:53:15.445162 (+ 2851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:15.445171 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:15.445194 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:15.445802 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:15.446189 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:15.446194 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:15.446198 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:15.446386 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:15.446916 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:53:15.446923 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:53:15.447311 (+ 388us) client_negotiation.cc:769] Sending connection context
0811 06:53:15.447600 (+ 289us) client_negotiation.cc:240] Negotiation successful
0811 06:53:15.448040 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":312,"threads_started":1}
I20260811 06:53:15.450070 6953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:15.430953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:49759 (local address 127.12.145.62:35133)
0811 06:53:15.433312 (+ 2359us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:15.433316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:15.433333 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:53:15.434338 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:15.434343 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:15.434418 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:15.434539 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:15.435977 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:15.436972 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:15.438504 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:15.439039 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:15.439169 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:15.442522 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:15.442527 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:15.442530 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:15.442563 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:15.445019 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:15.445915 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:15.445920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:15.445932 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:15.446056 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:15.446517 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:15.446522 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:15.446525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:15.446793 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:15.446933 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:15.449656 (+ 2723us) server_negotiation.cc:299] Negotiation successful
0811 06:53:15.449823 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2256,"thread_start_us":2156,"threads_started":1}
I20260811 06:53:15.451315 6950 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35133
I20260811 06:53:15.451586 6950 heartbeater.cc:464] Registering TS with master...
I20260811 06:53:15.452258 6950 heartbeater.cc:511] Master 127.12.145.62:35133 requested a full tablet report, sending...
I20260811 06:53:15.454242 6638 ts_manager.cc:194] Registered new tserver with Master: a8a77457629447fdac451d2f31e9c2be (127.12.145.1:41413)
I20260811 06:53:15.455659 6638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:49759
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:53:15.492518 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35133
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:53:15.819267 6959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:53:15.819521 6959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:53:15.819624 6959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:53:15.826656 6959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:53:15.826756 6959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:53:15.826874 6959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:53:15.836426 6959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35133
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:53:15.837698 6959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:53:15.838945 6959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:53:15.851223 6966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:15.851200 6967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:15.851611 6971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:53:15.852080 6959 server_base.cc:1034] running on GCE node
I20260811 06:53:15.852654 6959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:53:15.853587 6959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:53:15.854843 6959 hybrid_clock.cc:648] HybridClock initialized: now 1786431195854737 us; error 58 us; skew 500 ppm
I20260811 06:53:15.855163 6959 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:53:15 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431195, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:53:15.858299 6959 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:53:15.859817 6959 webserver.cc:460] Webserver started at http://127.12.145.2:38841/ using document root <none> and password file <none>
I20260811 06:53:15.860471 6959 fs_manager.cc:359] Metadata directory not provided
I20260811 06:53:15.860589 6959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:53:15.860872 6959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:53:15.863835 6959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "d7bd4dcf26434e61a135770e4d54c11d"
format_stamp: "Formatted at 2026-08-11 06:53:15 on dist-test-slave-7lbf"
server_key: "8381448d423f71f1c4f1c338892aa0d1"
server_key_iv: "41e4238b2bd7306f5a83167e88b2a60c"
server_key_version: "encryptionkey@0"
I20260811 06:53:15.864570 6959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "d7bd4dcf26434e61a135770e4d54c11d"
format_stamp: "Formatted at 2026-08-11 06:53:15 on dist-test-slave-7lbf"
server_key: "8381448d423f71f1c4f1c338892aa0d1"
server_key_iv: "41e4238b2bd7306f5a83167e88b2a60c"
server_key_version: "encryptionkey@0"
I20260811 06:53:15.869681 6959 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:53:15.873137 6985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:15.874449 6959 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:53:15.874608 6959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "d7bd4dcf26434e61a135770e4d54c11d"
format_stamp: "Formatted at 2026-08-11 06:53:15 on dist-test-slave-7lbf"
server_key: "8381448d423f71f1c4f1c338892aa0d1"
server_key_iv: "41e4238b2bd7306f5a83167e88b2a60c"
server_key_version: "encryptionkey@0"
I20260811 06:53:15.874782 6959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:53:15.895043 6959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:53:15.899093 6959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:53:15.899382 6959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:53:15.900341 6959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:53:15.901772 6959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:53:15.901850 6959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:15.901979 6959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:53:15.902033 6959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:15.932590 6959 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:40493
I20260811 06:53:15.932624 7179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:40493 every 8 connection(s)
I20260811 06:53:15.933928 6959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:53:15.939069 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 6959
I20260811 06:53:15.939248 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:53:15.939726 12868 external_mini_cluster.cc:1428] Setting key a9ab6ea768155bdbeedbe912a3008afb
Aug 11 06:53:15 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431195, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:53:15.954608 6953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:15.936541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:41515 (local address 127.12.145.62:35133)
0811 06:53:15.936760 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:15.936766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:15.937911 (+ 1145us) server_negotiation.cc:407] Connection header received
0811 06:53:15.939796 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:15.939802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:15.939895 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:15.940022 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:15.941711 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:15.942451 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:15.944558 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:15.944979 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:15.945069 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:15.948957 (+ 3888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:15.948962 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:15.948972 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:15.949006 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:15.951526 (+ 2520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:15.952322 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:15.952326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:15.952328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:15.952446 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:15.952869 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:15.952872 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:15.952873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:15.953127 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:15.953230 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:15.954043 (+ 813us) server_negotiation.cc:299] Negotiation successful
0811 06:53:15.954269 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 06:53:15.955384 7183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:15.937020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:41515)
0811 06:53:15.937746 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:15.937798 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:15.939521 (+ 1723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:15.940214 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:15.940222 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:15.940871 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:53:15.941491 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:15.941542 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:15.942609 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:15.942614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:15.944438 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:15.944453 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:15.945211 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:15.945218 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:15.945474 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:15.946204 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:53:15.946238 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:53:15.948721 (+ 2483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:53:15.951661 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:15.951670 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:15.951687 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:15.952221 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:15.952538 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:15.952542 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:15.952545 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:15.952770 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:15.953235 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:53:15.953242 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:53:15.953662 (+ 420us) client_negotiation.cc:769] Sending connection context
0811 06:53:15.953900 (+ 238us) client_negotiation.cc:240] Negotiation successful
0811 06:53:15.954272 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":266,"threads_started":1}
I20260811 06:53:15.956730 7180 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35133
I20260811 06:53:15.957065 7180 heartbeater.cc:464] Registering TS with master...
I20260811 06:53:15.957955 7180 heartbeater.cc:511] Master 127.12.145.62:35133 requested a full tablet report, sending...
I20260811 06:53:15.959671 6638 ts_manager.cc:194] Registered new tserver with Master: d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
I20260811 06:53:15.960569 6638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:41515
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:53:16.000603 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35133
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:53:16.324401 7189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:53:16.324672 7189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:53:16.324800 7189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:53:16.331955 7189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:53:16.332083 7189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:53:16.332270 7189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:53:16.342340 7189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35133
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:53:16.343606 7189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:53:16.344892 7189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:53:16.357695 7198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:16.357643 7203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:16.357718 7200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:53:16.358476 7189 server_base.cc:1034] running on GCE node
I20260811 06:53:16.359062 7189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:53:16.359964 7189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:53:16.361157 7189 hybrid_clock.cc:648] HybridClock initialized: now 1786431196361108 us; error 43 us; skew 500 ppm
I20260811 06:53:16.361438 7189 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:53:16 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431196, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:53:16.364435 7189 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:53:16.365993 7189 webserver.cc:460] Webserver started at http://127.12.145.3:42107/ using document root <none> and password file <none>
I20260811 06:53:16.366641 7189 fs_manager.cc:359] Metadata directory not provided
I20260811 06:53:16.366755 7189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:53:16.367049 7189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:53:16.369966 7189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "ecc551bb07e54d43b084e2eca2216b6d"
format_stamp: "Formatted at 2026-08-11 06:53:16 on dist-test-slave-7lbf"
server_key: "1383bd1486aab00436f78d37092eb014"
server_key_iv: "2b70a36a70476a834d85927114582ef9"
server_key_version: "encryptionkey@0"
I20260811 06:53:16.370688 7189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "ecc551bb07e54d43b084e2eca2216b6d"
format_stamp: "Formatted at 2026-08-11 06:53:16 on dist-test-slave-7lbf"
server_key: "1383bd1486aab00436f78d37092eb014"
server_key_iv: "2b70a36a70476a834d85927114582ef9"
server_key_version: "encryptionkey@0"
I20260811 06:53:16.375716 7189 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 06:53:16.379216 7212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:16.380535 7189 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:53:16.380712 7189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "ecc551bb07e54d43b084e2eca2216b6d"
format_stamp: "Formatted at 2026-08-11 06:53:16 on dist-test-slave-7lbf"
server_key: "1383bd1486aab00436f78d37092eb014"
server_key_iv: "2b70a36a70476a834d85927114582ef9"
server_key_version: "encryptionkey@0"
I20260811 06:53:16.380931 7189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:53:16.396483 7189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:53:16.400360 7189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:53:16.400656 7189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:53:16.401749 7189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:53:16.403123 7189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:53:16.403210 7189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:16.403342 7189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:53:16.403409 7189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:16.435940 7189 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:45701
I20260811 06:53:16.435999 7411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:45701 every 8 connection(s)
I20260811 06:53:16.437222 7189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:53:16.446645 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 7189
I20260811 06:53:16.446827 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:53:16.447376 12868 external_mini_cluster.cc:1428] Setting key 39a9973eac809a2e1cdda71d23049a3e
Aug 11 06:53:16 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431196, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:53:16.456431 6953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.439572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:49187 (local address 127.12.145.62:35133)
0811 06:53:16.439796 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.439803 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.440868 (+ 1065us) server_negotiation.cc:407] Connection header received
0811 06:53:16.442734 (+ 1866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.442738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.442833 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.442919 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:16.444307 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.445042 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.446890 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.447487 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.447619 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.451133 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:16.451139 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:16.451142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:16.451178 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:16.453785 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:16.454429 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:16.454433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:16.454435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:16.454559 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:16.454890 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:16.454893 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:16.454895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:16.455142 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:16.455248 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.455911 (+ 663us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.456097 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 06:53:16.457093 7417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.439981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:49187)
0811 06:53:16.440696 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:16.440734 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:16.442494 (+ 1760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:16.443113 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:16.443121 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:16.443629 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:53:16.444172 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.444190 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.445193 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.445197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.446675 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.446692 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.447691 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.447697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.447915 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.448590 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:53:16.448622 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:53:16.450943 (+ 2321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:53:16.453925 (+ 2982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:16.453932 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:16.453943 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:16.454337 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:16.454635 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:16.454638 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:16.454641 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:16.454811 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:16.455235 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:53:16.455240 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:53:16.455535 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 06:53:16.455744 (+ 209us) client_negotiation.cc:240] Negotiation successful
0811 06:53:16.456098 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":267,"threads_started":1}
I20260811 06:53:16.458468 6950 heartbeater.cc:503] Master 127.12.145.62:35133 was elected leader, sending a full tablet report...
I20260811 06:53:16.458483 7412 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35133
I20260811 06:53:16.458766 7412 heartbeater.cc:464] Registering TS with master...
I20260811 06:53:16.459499 7412 heartbeater.cc:511] Master 127.12.145.62:35133 requested a full tablet report, sending...
I20260811 06:53:16.460835 6638 ts_manager.cc:194] Registered new tserver with Master: ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701)
I20260811 06:53:16.461810 6638 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:49187
I20260811 06:53:16.462791 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:53:16.480242 6953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.467903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58928 (local address 127.12.145.62:35133)
0811 06:53:16.468061 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.468065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.468506 (+ 441us) server_negotiation.cc:407] Connection header received
0811 06:53:16.468642 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.468645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.468697 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.468772 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:16.470442 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.471148 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.472551 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.472936 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.473070 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.475410 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:16.475415 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:16.475418 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:16.475447 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:16.477664 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:16.478383 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:16.478388 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:16.478392 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:16.478521 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:16.478912 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:16.478915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:16.478917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:16.479278 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:16.479464 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.479811 (+ 347us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.479978 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:53:16.484104 6636 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58928:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:53:16.490932 6636 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:53:16.515110 7432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.503006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.0.0.1:51598)
0811 06:53:16.505693 (+ 2687us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:16.505710 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:16.506671 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:16.507676 (+ 1005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:16.507681 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:16.507717 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:16.508218 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.508234 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.510460 (+ 2226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.510478 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.512539 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.512550 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.514319 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.514326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.514483 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.514517 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 06:53:16.514580 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 06:53:16.514777 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2569,"mutex_wait_us":58,"spinlock_wait_cycles":1885056,"thread_start_us":2150,"threads_started":1}
I20260811 06:53:16.515143 7434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.503041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44080 (local address 127.12.145.3:45701)
0811 06:53:16.504982 (+ 1941us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.504994 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.505900 (+ 906us) server_negotiation.cc:407] Connection header received
0811 06:53:16.506485 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.506496 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.507018 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.507229 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:16.508055 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.509314 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.512246 (+ 2932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.513470 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.513631 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.513889 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.514586 (+ 697us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.514763 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1733,"thread_start_us":1533,"threads_started":1}
I20260811 06:53:16.515707 7439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.506256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38266 (local address 127.12.145.2:40493)
0811 06:53:16.507886 (+ 1630us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.507896 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.507924 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:53:16.508031 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.508039 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.508253 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.508462 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:16.508980 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.510751 (+ 1771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.512968 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.514383 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.514520 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.514710 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.515224 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.515393 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1474,"thread_start_us":1351,"threads_started":1}
I20260811 06:53:16.515731 7436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.506032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:40493 (local address 127.0.0.1:38266)
0811 06:53:16.507160 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:16.507177 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:16.507278 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:16.508462 (+ 1184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:16.508476 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:16.508502 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:16.508811 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.508822 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.510899 (+ 2077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.510903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.512801 (+ 1898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.512819 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.514811 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.514817 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.515007 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.515046 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 06:53:16.515167 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 06:53:16.515293 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":998,"mutex_wait_us":49,"thread_start_us":870,"threads_started":1}
I20260811 06:53:16.516703 7435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.503367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51598 (local address 127.12.145.1:41413)
0811 06:53:16.505236 (+ 1869us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.505245 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.505843 (+ 598us) server_negotiation.cc:407] Connection header received
0811 06:53:16.507199 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.507208 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.507427 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.508449 (+ 1022us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:16.508696 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.510280 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.512683 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.514051 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.515859 (+ 1808us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.516107 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.516190 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.516361 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1702,"thread_start_us":1529,"threads_started":1}
I20260811 06:53:16.517802 7433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.502760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:45701 (local address 127.0.0.1:44080)
0811 06:53:16.505596 (+ 2836us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:16.505634 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:16.506150 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:16.507441 (+ 1291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:16.507450 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:16.507490 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:16.507877 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.507890 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.509496 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.509502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.512065 (+ 2563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.512081 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.514042 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.514049 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.514267 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.514347 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 06:53:16.515434 (+ 1087us) client_negotiation.cc:240] Negotiation successful
0811 06:53:16.515560 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2559,"mutex_wait_us":48,"thread_start_us":2656,"threads_started":1}
I20260811 06:53:16.520025 7069 tablet_service.cc:1467] Processing CreateTablet for tablet 70b1e0401aa6452783179a9831539c06 (DEFAULT_TABLE table=test-table [id=f2cfd752d1624e7b97802e4e0b0522ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:53:16.520020 6845 tablet_service.cc:1467] Processing CreateTablet for tablet 70b1e0401aa6452783179a9831539c06 (DEFAULT_TABLE table=test-table [id=f2cfd752d1624e7b97802e4e0b0522ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:53:16.521222 6845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70b1e0401aa6452783179a9831539c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:53:16.521232 7069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70b1e0401aa6452783179a9831539c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:53:16.525727 7295 tablet_service.cc:1467] Processing CreateTablet for tablet 70b1e0401aa6452783179a9831539c06 (DEFAULT_TABLE table=test-table [id=f2cfd752d1624e7b97802e4e0b0522ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:53:16.527364 7295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70b1e0401aa6452783179a9831539c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:53:16.533686 7442 tablet_bootstrap.cc:492] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: Bootstrap starting.
I20260811 06:53:16.536458 7443 tablet_bootstrap.cc:492] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: Bootstrap starting.
I20260811 06:53:16.537441 7442 tablet_bootstrap.cc:654] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: Neither blocks nor log segments found. Creating new log.
I20260811 06:53:16.538801 7442 log.cc:824] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: Log is configured to *not* fsync() on all Append() calls
I20260811 06:53:16.539856 7443 tablet_bootstrap.cc:654] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: Neither blocks nor log segments found. Creating new log.
I20260811 06:53:16.541013 7443 log.cc:824] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: Log is configured to *not* fsync() on all Append() calls
I20260811 06:53:16.542275 7442 tablet_bootstrap.cc:492] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: No bootstrap required, opened a new log
I20260811 06:53:16.542636 7442 ts_tablet_manager.cc:1397] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260811 06:53:16.543161 7446 tablet_bootstrap.cc:492] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: Bootstrap starting.
I20260811 06:53:16.546103 7446 tablet_bootstrap.cc:654] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: Neither blocks nor log segments found. Creating new log.
I20260811 06:53:16.547214 7446 log.cc:824] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: Log is configured to *not* fsync() on all Append() calls
I20260811 06:53:16.548262 7443 tablet_bootstrap.cc:492] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: No bootstrap required, opened a new log
I20260811 06:53:16.548524 7443 ts_tablet_manager.cc:1397] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260811 06:53:16.549736 7446 tablet_bootstrap.cc:492] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: No bootstrap required, opened a new log
I20260811 06:53:16.549984 7446 ts_tablet_manager.cc:1397] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 06:53:16.553002 7442 raft_consensus.cc:348] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:16.553438 7442 raft_consensus.cc:374] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:53:16.553560 7442 raft_consensus.cc:729] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8a77457629447fdac451d2f31e9c2be, State: Initialized, Role: FOLLOWER
I20260811 06:53:16.554266 7442 consensus_queue.cc:260] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:16.556047 7442 ts_tablet_manager.cc:1428] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20260811 06:53:16.558317 7443 raft_consensus.cc:348] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:16.558748 7443 raft_consensus.cc:374] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:53:16.558844 7443 raft_consensus.cc:729] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7bd4dcf26434e61a135770e4d54c11d, State: Initialized, Role: FOLLOWER
I20260811 06:53:16.558857 7446 raft_consensus.cc:348] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:16.559203 7446 raft_consensus.cc:374] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:53:16.559304 7446 raft_consensus.cc:729] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc551bb07e54d43b084e2eca2216b6d, State: Initialized, Role: FOLLOWER
I20260811 06:53:16.559446 7443 consensus_queue.cc:260] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:16.559917 7446 consensus_queue.cc:260] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:16.560575 7180 heartbeater.cc:503] Master 127.12.145.62:35133 was elected leader, sending a full tablet report...
I20260811 06:53:16.561378 7412 heartbeater.cc:503] Master 127.12.145.62:35133 was elected leader, sending a full tablet report...
I20260811 06:53:16.561908 7446 ts_tablet_manager.cc:1428] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: Time spent starting tablet: real 0.012s user 0.007s sys 0.005s
I20260811 06:53:16.561144 7443 ts_tablet_manager.cc:1428] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
W20260811 06:53:16.680619 6952 tablet.cc:2369] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:53:16.685822 7182 tablet.cc:2369] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:53:16.687789 7456 raft_consensus.cc:482] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:53:16.688028 7456 raft_consensus.cc:504] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
W20260811 06:53:16.688948 7414 tablet.cc:2369] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:53:16.689764 7456 leader_election.cc:288] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701), d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
I20260811 06:53:16.695027 7458 raft_consensus.cc:482] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:53:16.695292 7458 raft_consensus.cc:504] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:16.697259 7439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.690283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:38483 (local address 127.12.145.2:40493)
0811 06:53:16.690485 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.690492 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.691128 (+ 636us) server_negotiation.cc:407] Connection header received
0811 06:53:16.691293 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.691297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.691357 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.691430 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:16.692007 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.692771 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.695469 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.696377 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.696532 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.696611 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.696876 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.696999 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 06:53:16.697429 7458 leader_election.cc:288] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701), a8a77457629447fdac451d2f31e9c2be (127.12.145.1:41413)
I20260811 06:53:16.697551 7463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.690267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:40493 (local address 127.12.145.1:38483)
0811 06:53:16.691016 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:16.691031 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:16.691161 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:16.691480 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:16.691484 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:16.691508 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:16.691849 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.691857 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.692906 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.692911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.695229 (+ 2318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.695244 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.696577 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.696583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.696726 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.696750 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 06:53:16.696831 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 06:53:16.696964 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":78,"thread_start_us":453,"threads_started":1}
I20260811 06:53:16.697747 7434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.690174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:36469 (local address 127.12.145.3:45701)
0811 06:53:16.690379 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.690386 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.690898 (+ 512us) server_negotiation.cc:407] Connection header received
0811 06:53:16.691109 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.691113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.691172 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.691244 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:16.691765 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.692625 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.695393 (+ 2768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.696563 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.696723 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.696793 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.697348 (+ 555us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.697496 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 06:53:16.698428 7461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.689975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:45701 (local address 127.12.145.1:36469)
0811 06:53:16.690783 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:16.690805 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:16.690964 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:16.691277 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:16.691281 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:16.691309 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:16.691624 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.691633 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.692748 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.692753 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.695228 (+ 2475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.695244 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.696965 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.696971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.697155 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.697188 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 06:53:16.697921 (+ 733us) client_negotiation.cc:240] Negotiation successful
0811 06:53:16.698055 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"mutex_wait_us":39,"thread_start_us":494,"threads_started":1}
I20260811 06:53:16.699694 7329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70b1e0401aa6452783179a9831539c06" candidate_uuid: "a8a77457629447fdac451d2f31e9c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc551bb07e54d43b084e2eca2216b6d" is_pre_election: true
I20260811 06:53:16.700264 7329 raft_consensus.cc:2454] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8a77457629447fdac451d2f31e9c2be in term 0.
I20260811 06:53:16.700212 7100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70b1e0401aa6452783179a9831539c06" candidate_uuid: "a8a77457629447fdac451d2f31e9c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7bd4dcf26434e61a135770e4d54c11d" is_pre_election: true
I20260811 06:53:16.700650 7100 raft_consensus.cc:2454] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8a77457629447fdac451d2f31e9c2be in term 0.
I20260811 06:53:16.701167 6762 leader_election.cc:302] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8a77457629447fdac451d2f31e9c2be, ecc551bb07e54d43b084e2eca2216b6d; no voters:
I20260811 06:53:16.701664 7456 raft_consensus.cc:2781] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:53:16.701825 7456 raft_consensus.cc:482] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:53:16.701929 7456 raft_consensus.cc:3037] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:53:16.704891 7434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.697997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:59477 (local address 127.12.145.3:45701)
0811 06:53:16.698147 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.698151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.698724 (+ 573us) server_negotiation.cc:407] Connection header received
0811 06:53:16.698973 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.698978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.699054 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.699115 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:16.700321 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.701364 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.703189 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.704005 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.704150 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.704218 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.704525 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.704642 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 06:53:16.704936 7465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.697875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:45701 (local address 127.12.145.2:59477)
0811 06:53:16.698625 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:16.698642 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:16.698831 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:16.699313 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:16.699317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:16.699344 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:16.700132 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.700147 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.701582 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.701586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.703038 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.703054 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.704229 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.704236 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.704387 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.704410 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 06:53:16.704490 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 06:53:16.704624 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":1025,"threads_started":1}
I20260811 06:53:16.705493 7329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70b1e0401aa6452783179a9831539c06" candidate_uuid: "d7bd4dcf26434e61a135770e4d54c11d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc551bb07e54d43b084e2eca2216b6d" is_pre_election: true
I20260811 06:53:16.705729 7329 raft_consensus.cc:2454] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7bd4dcf26434e61a135770e4d54c11d in term 0.
I20260811 06:53:16.706149 6987 leader_election.cc:302] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7bd4dcf26434e61a135770e4d54c11d, ecc551bb07e54d43b084e2eca2216b6d; no voters:
I20260811 06:53:16.705109 7456 raft_consensus.cc:504] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:16.706907 7435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.698849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:58441 (local address 127.12.145.1:41413)
0811 06:53:16.699154 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.699160 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.700133 (+ 973us) server_negotiation.cc:407] Connection header received
0811 06:53:16.700395 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.700401 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.700486 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.700552 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:16.701358 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.702429 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.704829 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.705987 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.706125 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.706192 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.706611 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.706712 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
I20260811 06:53:16.706993 7467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.698498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.12.145.2:58441)
0811 06:53:16.700028 (+ 1530us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:16.700049 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:16.700230 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:16.700736 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:16.700741 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:16.700770 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:16.701194 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.701207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.702630 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.702635 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.704633 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:16.704649 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.706204 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.706211 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:16.706377 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.706410 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 06:53:16.706573 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 06:53:16.706695 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1387,"thread_start_us":1202,"threads_started":1}
I20260811 06:53:16.707412 7100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70b1e0401aa6452783179a9831539c06" candidate_uuid: "a8a77457629447fdac451d2f31e9c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7bd4dcf26434e61a135770e4d54c11d"
I20260811 06:53:16.707501 7329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70b1e0401aa6452783179a9831539c06" candidate_uuid: "a8a77457629447fdac451d2f31e9c2be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecc551bb07e54d43b084e2eca2216b6d"
I20260811 06:53:16.707633 7100 raft_consensus.cc:3037] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:53:16.707690 7329 raft_consensus.cc:3037] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:53:16.708019 6876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70b1e0401aa6452783179a9831539c06" candidate_uuid: "d7bd4dcf26434e61a135770e4d54c11d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8a77457629447fdac451d2f31e9c2be" is_pre_election: true
I20260811 06:53:16.708454 6876 raft_consensus.cc:2379] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7bd4dcf26434e61a135770e4d54c11d in current term 1: Already voted for candidate a8a77457629447fdac451d2f31e9c2be in this term.
I20260811 06:53:16.709128 7456 leader_election.cc:288] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 1 election: Requested vote from peers ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701), d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
I20260811 06:53:16.710322 7329 raft_consensus.cc:2454] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8a77457629447fdac451d2f31e9c2be in term 1.
I20260811 06:53:16.710426 7100 raft_consensus.cc:2454] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8a77457629447fdac451d2f31e9c2be in term 1.
I20260811 06:53:16.710644 7458 raft_consensus.cc:2741] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260811 06:53:16.710670 6762 leader_election.cc:302] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8a77457629447fdac451d2f31e9c2be, ecc551bb07e54d43b084e2eca2216b6d; no voters:
I20260811 06:53:16.710983 7456 raft_consensus.cc:2781] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:53:16.711416 7456 raft_consensus.cc:686] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 1 LEADER]: Becoming Leader. State: Replica: a8a77457629447fdac451d2f31e9c2be, State: Running, Role: LEADER
I20260811 06:53:16.711867 7456 consensus_queue.cc:237] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:16.716148 6638 catalog_manager.cc:5495] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be reported cstate change: term changed from 0 to 1, leader changed from <none> to a8a77457629447fdac451d2f31e9c2be (127.12.145.1). New cstate: current_term: 1 leader_uuid: "a8a77457629447fdac451d2f31e9c2be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } health_report { overall_health: UNKNOWN } } }
I20260811 06:53:16.751751 7435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.746172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51610 (local address 127.12.145.1:41413)
0811 06:53:16.746372 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.746378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.746468 (+ 90us) server_negotiation.cc:407] Connection header received
0811 06:53:16.746694 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.746698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.746794 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.746936 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:53:16.747370 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.748183 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.749613 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.750031 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.750141 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.750649 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:53:16.751169 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:53:16.751323 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.751399 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.751481 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 06:53:16.759836 7100 raft_consensus.cc:1261] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 1 FOLLOWER]: Refusing update from remote peer a8a77457629447fdac451d2f31e9c2be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:53:16.759917 7329 raft_consensus.cc:1261] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [term 1 FOLLOWER]: Refusing update from remote peer a8a77457629447fdac451d2f31e9c2be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:53:16.760676 7468 consensus_queue.cc:1035] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:53:16.760985 7456 consensus_queue.cc:1035] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:53:16.790629 6638 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58928:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:53:16.790959 6638 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58928:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:53:16.795877 6638 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Sending DeleteTablet for 3 replicas of tablet 70b1e0401aa6452783179a9831539c06
I20260811 06:53:16.797081 7295 tablet_service.cc:1514] Processing DeleteTablet for tablet 70b1e0401aa6452783179a9831539c06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:53:16 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:44080
I20260811 06:53:16.797158 6845 tablet_service.cc:1514] Processing DeleteTablet for tablet 70b1e0401aa6452783179a9831539c06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:53:16 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:51598
I20260811 06:53:16.803951 7069 tablet_service.cc:1514] Processing DeleteTablet for tablet 70b1e0401aa6452783179a9831539c06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:53:16 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:38266
I20260811 06:53:16.812355 7494 tablet_replica.cc:330] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: stopping tablet replica
I20260811 06:53:16.812829 7494 raft_consensus.cc:2229] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:53:16.813354 7494 raft_consensus.cc:2258] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:53:16.814474 7499 tablet_replica.cc:330] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: stopping tablet replica
I20260811 06:53:16.814574 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 6742
I20260811 06:53:16.814899 7499 raft_consensus.cc:2229] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:53:16.815373 7499 raft_consensus.cc:2258] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:53:16.815773 7494 ts_tablet_manager.cc:1905] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:53:16.817399 7499 ts_tablet_manager.cc:1905] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:53:16.822579 7494 ts_tablet_manager.cc:1918] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:53:16.822742 7494 log.cc:1196] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/70b1e0401aa6452783179a9831539c06
I20260811 06:53:16.823246 7494 ts_tablet_manager.cc:1939] T 70b1e0401aa6452783179a9831539c06 P ecc551bb07e54d43b084e2eca2216b6d: Deleting consensus metadata
I20260811 06:53:16.823798 7496 tablet_replica.cc:330] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: stopping tablet replica
I20260811 06:53:16.824105 7499 ts_tablet_manager.cc:1918] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:53:16.824282 7499 log.cc:1196] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/70b1e0401aa6452783179a9831539c06
I20260811 06:53:16.824491 7496 raft_consensus.cc:2229] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:53:16.824812 7499 ts_tablet_manager.cc:1939] T 70b1e0401aa6452783179a9831539c06 P d7bd4dcf26434e61a135770e4d54c11d: Deleting consensus metadata
I20260811 06:53:16.825127 6612 catalog_manager.cc:4841] TS ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701): tablet 70b1e0401aa6452783179a9831539c06 (table test-table [id=f2cfd752d1624e7b97802e4e0b0522ca]) successfully deleted
I20260811 06:53:16.825340 7496 raft_consensus.cc:2258] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:53:16.827423 7496 ts_tablet_manager.cc:1905] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:53:16.829320 6615 catalog_manager.cc:4841] TS d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493): tablet 70b1e0401aa6452783179a9831539c06 (table test-table [id=f2cfd752d1624e7b97802e4e0b0522ca]) successfully deleted
Aug 11 06:53:16 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:53:16.835501 7496 ts_tablet_manager.cc:1918] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:53:16.835690 7496 log.cc:1196] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/70b1e0401aa6452783179a9831539c06
I20260811 06:53:16.836315 7496 ts_tablet_manager.cc:1939] T 70b1e0401aa6452783179a9831539c06 P a8a77457629447fdac451d2f31e9c2be: Deleting consensus metadata
I20260811 06:53:16.838208 6615 catalog_manager.cc:4841] TS a8a77457629447fdac451d2f31e9c2be (127.12.145.1:41413): tablet 70b1e0401aa6452783179a9831539c06 (table test-table [id=f2cfd752d1624e7b97802e4e0b0522ca]) successfully deleted
I20260811 06:53:16.839671 7435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.815734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51618 (local address 127.12.145.1:41413)
0811 06:53:16.815914 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.815920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.822106 (+ 6186us) server_negotiation.cc:407] Connection header received
0811 06:53:16.822420 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.822427 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.822529 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.822617 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:16.824825 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.826008 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.828050 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.828698 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.828857 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.833258 (+ 4401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:16.833270 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:16.833283 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:16.833333 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:16.836704 (+ 3371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:16.837446 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:16.837454 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:16.837456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:16.837645 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:16.838039 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:16.838045 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:16.838048 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:16.838469 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:16.838797 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.839140 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.839370 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:53:16.840319 6943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:16.940100 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 6742
I20260811 06:53:16.967538 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 6959
Aug 11 06:53:16 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:53:16.982532 7439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:16.968296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38268 (local address 127.12.145.2:40493)
0811 06:53:16.968453 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:16.968457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:16.968486 (+ 29us) server_negotiation.cc:407] Connection header received
0811 06:53:16.968644 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:16.968648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:16.968725 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:16.968808 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:16.970201 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.970992 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.972259 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:16.972668 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:16.972760 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:16.977020 (+ 4260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:16.977034 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:16.977050 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:16.977089 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:16.980055 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:16.980777 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:16.980783 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:16.980785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:16.980926 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:16.981207 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:16.981210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:16.981212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:16.981641 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:16.981855 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:16.982109 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 06:53:16.982276 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 06:53:16.983160 7173 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:17.073674 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 6959
I20260811 06:53:17.097478 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 7189
Aug 11 06:53:17 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:53:17.112106 7434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:17.098233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44090 (local address 127.12.145.3:45701)
0811 06:53:17.098420 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:17.098426 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:17.098470 (+ 44us) server_negotiation.cc:407] Connection header received
0811 06:53:17.098687 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:17.098693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:17.098763 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:17.098847 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:17.100235 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:17.100916 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:17.102318 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:17.102735 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:17.102848 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:17.107239 (+ 4391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:17.107254 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:17.107272 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:17.107314 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:17.109789 (+ 2475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:17.110439 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:17.110447 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:17.110449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:17.110591 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:17.110908 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:17.110911 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:17.110913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:17.111256 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:17.111480 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:17.111704 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 06:53:17.111866 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:53:17.112705 7402 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:17.200057 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 7189
I20260811 06:53:17.224476 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 6587
I20260811 06:53:17.225661 6690 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:17.335213 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 6587
I20260811 06:53:37.371428 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35133
--webserver_interface=127.12.145.62
--webserver_port=33359
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:35133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:53:37.697834 7508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:53:37.698103 7508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:53:37.698233 7508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:53:37.705185 7508 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 06:53:37.705279 7508 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 06:53:37.705317 7508 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 06:53:37.705387 7508 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:53:37.705461 7508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:53:37.705554 7508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:53:37.705613 7508 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:53:37.705690 7508 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:53:37.715443 7508 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:35133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=33359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:53:37.716689 7508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:53:37.718050 7508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:53:37.743149 7520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:37.743218 7517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:37.743166 7527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:53:37.743862 7508 server_base.cc:1034] running on GCE node
I20260811 06:53:37.744750 7508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:53:37.746313 7508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:53:37.747545 7508 hybrid_clock.cc:648] HybridClock initialized: now 1786431217747474 us; error 44 us; skew 500 ppm
I20260811 06:53:37.747921 7508 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:53:37 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431217, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:53:37.755105 7508 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:53:37.756765 7508 webserver.cc:460] Webserver started at http://127.12.145.62:33359/ using document root <none> and password file <none>
I20260811 06:53:37.757578 7508 fs_manager.cc:359] Metadata directory not provided
I20260811 06:53:37.757711 7508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:53:37.763712 7508 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 06:53:37.766729 7537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:37.768095 7508 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:53:37.768257 7508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "8ff16d4aaf6041dc926361912f4911a3"
format_stamp: "Formatted at 2026-08-11 06:53:14 on dist-test-slave-7lbf"
server_key: "3c3dfac5cdbddd2c516bfde60eea0916"
server_key_iv: "3b88ac31adcaa4c91481ea381d711a3b"
server_key_version: "encryptionkey@0"
I20260811 06:53:37.769284 7508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:53:37.791270 7508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:53:37.795270 7508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:53:37.795553 7508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:53:37.813858 7508 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:35133
I20260811 06:53:37.813920 7622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:35133 every 8 connection(s)
I20260811 06:53:37.815397 7508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:53:37.819453 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 7508
I20260811 06:53:37.820546 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:41413
--local_ip_for_outbound_sockets=127.12.145.1
--tserver_master_addrs=127.12.145.62:35133
--webserver_port=37891
--webserver_interface=127.12.145.1
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:53:37.824800 7628 sys_catalog.cc:263] Verifying existing consensus state
I20260811 06:53:37.829483 7628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Bootstrap starting.
I20260811 06:53:37.850049 7628 log.cc:824] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Log is configured to *not* fsync() on all Append() calls
I20260811 06:53:37.862708 7628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 06:53:37.863247 7628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Bootstrap complete.
I20260811 06:53:37.872638 7628 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:53:37.873615 7628 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff16d4aaf6041dc926361912f4911a3, State: Initialized, Role: FOLLOWER
I20260811 06:53:37.874307 7628 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:53:37.874552 7628 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:53:37.874666 7628 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:53:37.874835 7628 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:53:37.878836 7628 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:53:37.879401 7628 leader_election.cc:302] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ff16d4aaf6041dc926361912f4911a3; no voters:
I20260811 06:53:37.880016 7628 leader_election.cc:288] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 06:53:37.880172 7634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 06:53:37.881363 7634 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 2 LEADER]: Becoming Leader. State: Replica: 8ff16d4aaf6041dc926361912f4911a3, State: Running, Role: LEADER
I20260811 06:53:37.881942 7634 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:53:37.882496 7628 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:53:37.884521 7637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ff16d4aaf6041dc926361912f4911a3. Latest consensus state: current_term: 2 leader_uuid: "8ff16d4aaf6041dc926361912f4911a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } } }
I20260811 06:53:37.884984 7637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: This master's current role is: LEADER
I20260811 06:53:37.885617 7635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8ff16d4aaf6041dc926361912f4911a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } } }
I20260811 06:53:37.886088 7635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: This master's current role is: LEADER
I20260811 06:53:37.895051 7644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:53:37.903946 7644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:53:37.905593 7644 catalog_manager.cc:1259] Loaded cluster ID: 51c7251711ad4f438c9387a3322baf1f
I20260811 06:53:37.905704 7644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:53:37.909825 7644 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:53:37.911434 7644 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Loaded TSK: 0
I20260811 06:53:37.923055 7661 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 06:53:37.940775 7644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Generated new TSK 1
I20260811 06:53:37.941131 7644 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 06:53:38.206928 7630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:53:38.207305 7630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:53:38.207473 7630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:53:38.214715 7630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:53:38.214843 7630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:53:38.214989 7630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:53:38.224647 7630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:41413
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=37891
--tserver_master_addrs=127.12.145.62:35133
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:53:38.226025 7630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:53:38.227299 7630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:53:38.241448 7669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:38.241466 7668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:38.242658 7671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:53:38.242700 7630 server_base.cc:1034] running on GCE node
I20260811 06:53:38.243374 7630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:53:38.244319 7630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:53:38.245584 7630 hybrid_clock.cc:648] HybridClock initialized: now 1786431218245524 us; error 40 us; skew 500 ppm
I20260811 06:53:38.245944 7630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:53:38 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431218, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:53:38.248960 7630 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:53:38.250510 7630 webserver.cc:460] Webserver started at http://127.12.145.1:37891/ using document root <none> and password file <none>
I20260811 06:53:38.251201 7630 fs_manager.cc:359] Metadata directory not provided
I20260811 06:53:38.251332 7630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:53:38.256841 7630 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 06:53:38.259649 7684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:38.260999 7630 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:53:38.261154 7630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "a8a77457629447fdac451d2f31e9c2be"
format_stamp: "Formatted at 2026-08-11 06:53:15 on dist-test-slave-7lbf"
server_key: "8b5bb5c65bafcef3de8ffaceee84187a"
server_key_iv: "ef1f4e08791a3e77f710b421caa5cfd1"
server_key_version: "encryptionkey@0"
I20260811 06:53:38.262159 7630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:53:38.277282 7630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:53:38.281594 7630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:53:38.281872 7630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:53:38.283007 7630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:53:38.284507 7630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:53:38.284600 7630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:38.284709 7630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:53:38.284785 7630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:38.320541 7630 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:41413
I20260811 06:53:38.320592 7890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:41413 every 8 connection(s)
I20260811 06:53:38.322046 7630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:53:38.323587 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 7630
I20260811 06:53:38.324323 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:40493
--local_ip_for_outbound_sockets=127.12.145.2
--tserver_master_addrs=127.12.145.62:35133
--webserver_port=38841
--webserver_interface=127.12.145.2
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:53:38 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431218, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:53:38.345589 7895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:38.325007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:55673 (local address 127.12.145.62:35133)
0811 06:53:38.326007 (+ 1000us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:38.326018 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:38.326680 (+ 662us) server_negotiation.cc:407] Connection header received
0811 06:53:38.328803 (+ 2123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:38.328815 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:38.329161 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:38.329498 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:38.331134 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:38.332373 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:38.333960 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:38.334615 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:38.334791 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:38.338372 (+ 3581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:38.338380 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:38.338393 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:38.338437 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:38.341145 (+ 2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:38.341931 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:38.341937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:38.341943 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:38.342116 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:38.342543 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:38.342547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:38.342549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:38.343005 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:38.343194 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:38.343989 (+ 795us) server_negotiation.cc:299] Negotiation successful
0811 06:53:38.344386 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":798,"thread_start_us":655,"threads_started":1}
I20260811 06:53:38.345594 7897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:38.325250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:55673)
0811 06:53:38.326488 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:38.326534 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:38.328259 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:38.329715 (+ 1456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:38.329727 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:38.330330 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:53:38.330900 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:38.330918 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:38.332547 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:38.332551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:38.333818 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:38.333832 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:38.334849 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:38.334856 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:38.335129 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:38.335784 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:53:38.335807 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:53:38.338091 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:53:38.341293 (+ 3202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:38.341302 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:38.341318 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:38.341790 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:38.342232 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:38.342237 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:38.342241 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:38.342424 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:38.343153 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:53:38.343161 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:53:38.343486 (+ 325us) client_negotiation.cc:769] Sending connection context
0811 06:53:38.343715 (+ 229us) client_negotiation.cc:240] Negotiation successful
0811 06:53:38.344269 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":989,"thread_start_us":797,"threads_started":1}
I20260811 06:53:38.348474 7892 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35133
I20260811 06:53:38.348758 7892 heartbeater.cc:464] Registering TS with master...
I20260811 06:53:38.349465 7892 heartbeater.cc:511] Master 127.12.145.62:35133 requested a full tablet report, sending...
I20260811 06:53:38.351622 7568 ts_manager.cc:194] Registered new tserver with Master: a8a77457629447fdac451d2f31e9c2be (127.12.145.1:41413)
I20260811 06:53:38.353076 7568 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:55673
W20260811 06:53:38.654918 7898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:53:38.655213 7898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:53:38.655365 7898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:53:38.662458 7898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:53:38.662567 7898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:53:38.662714 7898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:53:38.672457 7898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:40493
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=38841
--tserver_master_addrs=127.12.145.62:35133
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:53:38.673801 7898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:53:38.675091 7898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:53:38.689294 7906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:38.689342 7907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:38.689491 7911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:53:38.690718 7898 server_base.cc:1034] running on GCE node
I20260811 06:53:38.691339 7898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:53:38.692242 7898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:53:38.693440 7898 hybrid_clock.cc:648] HybridClock initialized: now 1786431218693386 us; error 52 us; skew 500 ppm
I20260811 06:53:38.693766 7898 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:53:38 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431218, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:53:38.696856 7898 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:53:38.698338 7898 webserver.cc:460] Webserver started at http://127.12.145.2:38841/ using document root <none> and password file <none>
I20260811 06:53:38.698982 7898 fs_manager.cc:359] Metadata directory not provided
I20260811 06:53:38.699095 7898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:53:38.704382 7898 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 06:53:38.707183 7919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:38.708560 7898 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:53:38.708725 7898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "d7bd4dcf26434e61a135770e4d54c11d"
format_stamp: "Formatted at 2026-08-11 06:53:15 on dist-test-slave-7lbf"
server_key: "8381448d423f71f1c4f1c338892aa0d1"
server_key_iv: "41e4238b2bd7306f5a83167e88b2a60c"
server_key_version: "encryptionkey@0"
I20260811 06:53:38.709729 7898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:53:38.732251 7898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:53:38.736306 7898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:53:38.736554 7898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:53:38.737582 7898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:53:38.738961 7898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:53:38.739071 7898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:38.739171 7898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:53:38.739231 7898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:38.769502 7898 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:40493
I20260811 06:53:38.769626 8098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:40493 every 8 connection(s)
I20260811 06:53:38.771028 7898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:53:38.774762 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 7898
I20260811 06:53:38.775468 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:45701
--local_ip_for_outbound_sockets=127.12.145.3
--tserver_master_addrs=127.12.145.62:35133
--webserver_port=42107
--webserver_interface=127.12.145.3
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 06:53:38 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431218, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:53:38.793061 8106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:38.773979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:52527)
0811 06:53:38.774682 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:38.774720 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:38.776411 (+ 1691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:38.777123 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:38.777132 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:38.777699 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:53:38.778264 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:38.778282 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:38.779299 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:38.779303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:38.780533 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:38.780546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:38.781395 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:38.781406 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:38.781673 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:38.782297 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:53:38.782325 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:53:38.784545 (+ 2220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:53:38.787961 (+ 3416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:38.787971 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:38.787990 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:38.788556 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:38.789082 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:38.789086 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:38.789090 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:38.789354 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:38.790189 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:53:38.790213 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:53:38.790743 (+ 530us) client_negotiation.cc:769] Sending connection context
0811 06:53:38.791035 (+ 292us) client_negotiation.cc:240] Negotiation successful
0811 06:53:38.791591 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":282,"threads_started":1}
I20260811 06:53:38.794298 7895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:38.773506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:52527 (local address 127.12.145.62:35133)
0811 06:53:38.773707 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:38.773712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:38.774834 (+ 1122us) server_negotiation.cc:407] Connection header received
0811 06:53:38.776687 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:38.776693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:38.776778 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:38.776864 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:38.778441 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:38.779134 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:38.780682 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:38.781119 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:38.781232 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:38.784779 (+ 3547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:38.784784 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:38.784787 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:38.784823 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:38.787818 (+ 2995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:38.788733 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:38.788740 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:38.788744 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:38.788936 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:38.789500 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:38.789555 (+ 55us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:38.789559 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:38.789959 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:38.790111 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:38.793681 (+ 3570us) server_negotiation.cc:299] Negotiation successful
0811 06:53:38.793968 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 06:53:38.795593 8099 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35133
I20260811 06:53:38.795944 8099 heartbeater.cc:464] Registering TS with master...
I20260811 06:53:38.796905 8099 heartbeater.cc:511] Master 127.12.145.62:35133 requested a full tablet report, sending...
I20260811 06:53:38.798588 7568 ts_manager.cc:194] Registered new tserver with Master: d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
I20260811 06:53:38.799438 7568 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:52527
W20260811 06:53:39.108165 8107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:53:39.108436 8107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:53:39.108553 8107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:53:39.115655 8107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:53:39.115767 8107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:53:39.115911 8107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:53:39.125166 8107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:45701
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=42107
--tserver_master_addrs=127.12.145.62:35133
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:53:39.126395 8107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:53:39.127737 8107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:53:39.140331 8117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:39.140599 8121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:53:39.141053 8124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:53:39.141660 8107 server_base.cc:1034] running on GCE node
I20260811 06:53:39.142203 8107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:53:39.143046 8107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:53:39.144275 8107 hybrid_clock.cc:648] HybridClock initialized: now 1786431219144219 us; error 39 us; skew 500 ppm
I20260811 06:53:39.144584 8107 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:53:39 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431219, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:53:39.147874 8107 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:53:39.149263 8107 webserver.cc:460] Webserver started at http://127.12.145.3:42107/ using document root <none> and password file <none>
I20260811 06:53:39.149981 8107 fs_manager.cc:359] Metadata directory not provided
I20260811 06:53:39.150127 8107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:53:39.155542 8107 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 06:53:39.158275 8134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:39.159534 8107 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:53:39.159680 8107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "ecc551bb07e54d43b084e2eca2216b6d"
format_stamp: "Formatted at 2026-08-11 06:53:16 on dist-test-slave-7lbf"
server_key: "1383bd1486aab00436f78d37092eb014"
server_key_iv: "2b70a36a70476a834d85927114582ef9"
server_key_version: "encryptionkey@0"
I20260811 06:53:39.160647 8107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:53:39.177474 8107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:53:39.181439 8107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:53:39.181749 8107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:53:39.182773 8107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:53:39.184165 8107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:53:39.184262 8107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:39.184356 8107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:53:39.184430 8107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:53:39.216115 8107 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:45701
I20260811 06:53:39.216181 8311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:45701 every 8 connection(s)
I20260811 06:53:39.217558 8107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:53:39.218679 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 8107
Aug 11 06:53:39 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431219, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:53:39.234280 7895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.219668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54114 (local address 127.12.145.62:35133)
0811 06:53:39.219886 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.219892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.220974 (+ 1082us) server_negotiation.cc:407] Connection header received
0811 06:53:39.221210 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.221216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.221311 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.221424 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:39.223182 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.224320 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.225755 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.226188 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.226300 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.228823 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:39.228829 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:39.228834 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:39.228871 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:39.231589 (+ 2718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.232268 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.232272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.232274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.232409 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.232760 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.232764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.232766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.233062 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:39.233321 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.233694 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.233960 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 06:53:39.237879 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.220030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:35981 (local address 127.12.145.62:35133)
0811 06:53:39.220514 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.220521 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.221692 (+ 1171us) server_negotiation.cc:407] Connection header received
0811 06:53:39.223689 (+ 1997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.223693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.223753 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.223834 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:39.225441 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.226210 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.227693 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.228098 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.228200 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.231771 (+ 3571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:39.231776 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:39.231789 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:39.231820 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:39.234840 (+ 3020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.235550 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.235554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.235556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.235716 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.236229 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.236234 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.236238 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.236538 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:39.236692 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.237365 (+ 673us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.237560 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":249,"threads_started":1}
I20260811 06:53:39.238719 8317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.220680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:35981)
0811 06:53:39.221547 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.221596 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:39.223403 (+ 1807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:39.224103 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:39.224114 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:39.224714 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:53:39.225268 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.225286 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.226359 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.226363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.227550 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.227562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.228315 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.228324 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.228549 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.229114 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:53:39.229135 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:53:39.231523 (+ 2388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:53:39.234987 (+ 3464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:39.234996 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:39.235011 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:39.235420 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:39.235829 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:53:39.235832 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:53:39.235834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:53:39.236104 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:53:39.236682 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:53:39.236690 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:53:39.237054 (+ 364us) client_negotiation.cc:769] Sending connection context
0811 06:53:39.237272 (+ 218us) client_negotiation.cc:240] Negotiation successful
0811 06:53:39.237670 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":314,"threads_started":1}
I20260811 06:53:39.239967 8312 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35133
I20260811 06:53:39.240236 8312 heartbeater.cc:464] Registering TS with master...
I20260811 06:53:39.240923 8312 heartbeater.cc:511] Master 127.12.145.62:35133 requested a full tablet report, sending...
I20260811 06:53:39.242211 7568 ts_manager.cc:194] Registered new tserver with Master: ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701)
I20260811 06:53:39.242980 7568 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:35981
I20260811 06:53:39.249010 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:53:39.255419 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.249901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54116 (local address 127.12.145.62:35133)
0811 06:53:39.250055 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.250060 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.250484 (+ 424us) server_negotiation.cc:407] Connection header received
0811 06:53:39.250699 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.250703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.250863 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.250985 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:53:39.251419 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.252143 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.253548 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.253963 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.254070 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.254556 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:53:39.254827 (+ 271us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 06:53:39.255168 (+ 341us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54116: token expired
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 06:53:39.255525 8316 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54116: token expired
W20260811 06:53:39.255995 7418 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.145.62:35133)
I20260811 06:53:39.268178 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.256453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54126 (local address 127.12.145.62:35133)
0811 06:53:39.256577 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.256580 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.256594 (+ 14us) server_negotiation.cc:407] Connection header received
0811 06:53:39.256713 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.256716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.256766 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.256864 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:39.258161 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.258846 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.260133 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.260568 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.260672 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.263093 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:39.263098 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:39.263102 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:39.263133 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:39.265772 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.266473 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.266477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.266479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.266631 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.267028 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.267032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.267034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.267319 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:39.267518 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.267719 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.267904 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 06:53:39.271358 7568 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54126:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:53:39.278730 7568 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:53:39.300662 8326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.289660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:45701 (local address 127.0.0.1:51056)
0811 06:53:39.290605 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.290651 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:39.290839 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:39.292916 (+ 2077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:39.292921 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:39.292946 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:39.293246 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.293254 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.295196 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.295206 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.297699 (+ 2493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.297714 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.299810 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.299816 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.299969 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.300004 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 06:53:39.300113 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 06:53:39.300272 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":520,"threads_started":1}
I20260811 06:53:39.300868 8328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.290013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51056 (local address 127.12.145.3:45701)
0811 06:53:39.292253 (+ 2240us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.292261 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.292298 (+ 37us) server_negotiation.cc:407] Connection header received
0811 06:53:39.292404 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.292414 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.292671 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.292869 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:39.293580 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.295068 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.298183 (+ 3115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.299412 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.299484 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.299648 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.300395 (+ 747us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.300559 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2062,"thread_start_us":1887,"threads_started":1}
I20260811 06:53:39.301846 8330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.290702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51228 (local address 127.12.145.1:41413)
0811 06:53:39.291711 (+ 1009us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.291720 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.293783 (+ 2063us) server_negotiation.cc:407] Connection header received
0811 06:53:39.294109 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.294116 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.294331 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.294504 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:39.295388 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.296924 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.298998 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.300408 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.300539 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.300716 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.301354 (+ 638us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.301540 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":570,"threads_started":1}
I20260811 06:53:39.302282 8327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.290046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.0.0.1:51228)
0811 06:53:39.293674 (+ 3628us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.293691 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:39.293888 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:39.294773 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:39.294778 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:39.294804 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:39.295136 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.295147 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.297106 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.297110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.298824 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.298837 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.300851 (+ 2014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.300857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.301108 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.301145 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 06:53:39.301265 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 06:53:39.301390 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3517,"mutex_wait_us":44,"thread_start_us":3328,"threads_started":1}
I20260811 06:53:39.304440 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.294316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:40493 (local address 127.0.0.1:45962)
0811 06:53:39.296007 (+ 1691us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.296023 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:39.296143 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:39.296752 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:39.296756 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:39.296786 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:39.297238 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.297250 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.299104 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.299110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.301096 (+ 1986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.301110 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.303704 (+ 2594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.303710 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.303869 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.303902 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 06:53:39.303991 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 06:53:39.304112 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1570,"mutex_wait_us":23,"thread_start_us":1409,"threads_started":1}
I20260811 06:53:39.304518 8331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.294046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45962 (local address 127.12.145.2:40493)
0811 06:53:39.295567 (+ 1521us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.295575 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.296120 (+ 545us) server_negotiation.cc:407] Connection header received
0811 06:53:39.296335 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.296343 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.296552 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.296723 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:39.297448 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.298991 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.301284 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.303500 (+ 2216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.303622 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.303810 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.304036 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.304194 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1364,"thread_start_us":1231,"threads_started":1}
I20260811 06:53:39.305052 8211 tablet_service.cc:1467] Processing CreateTablet for tablet 686af7efca894983b0bdbe0da518b913 (DEFAULT_TABLE table=test-table [id=f6e79130cc06470e9e7239237a8b8aa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:53:39.305845 7780 tablet_service.cc:1467] Processing CreateTablet for tablet 686af7efca894983b0bdbe0da518b913 (DEFAULT_TABLE table=test-table [id=f6e79130cc06470e9e7239237a8b8aa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:53:39.306587 8211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 686af7efca894983b0bdbe0da518b913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:53:39.307531 7780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 686af7efca894983b0bdbe0da518b913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:53:39.307574 7993 tablet_service.cc:1467] Processing CreateTablet for tablet 686af7efca894983b0bdbe0da518b913 (DEFAULT_TABLE table=test-table [id=f6e79130cc06470e9e7239237a8b8aa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:53:39.308611 7993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 686af7efca894983b0bdbe0da518b913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:53:39.321985 8338 tablet_bootstrap.cc:492] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: Bootstrap starting.
I20260811 06:53:39.323472 8340 tablet_bootstrap.cc:492] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Bootstrap starting.
I20260811 06:53:39.325917 8338 tablet_bootstrap.cc:654] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: Neither blocks nor log segments found. Creating new log.
I20260811 06:53:39.326145 8337 tablet_bootstrap.cc:492] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: Bootstrap starting.
I20260811 06:53:39.326670 8340 tablet_bootstrap.cc:654] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Neither blocks nor log segments found. Creating new log.
I20260811 06:53:39.327240 8338 log.cc:824] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: Log is configured to *not* fsync() on all Append() calls
I20260811 06:53:39.328079 8340 log.cc:824] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Log is configured to *not* fsync() on all Append() calls
I20260811 06:53:39.329954 8337 tablet_bootstrap.cc:654] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: Neither blocks nor log segments found. Creating new log.
I20260811 06:53:39.331276 8337 log.cc:824] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: Log is configured to *not* fsync() on all Append() calls
I20260811 06:53:39.336644 8338 tablet_bootstrap.cc:492] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: No bootstrap required, opened a new log
I20260811 06:53:39.336951 8338 ts_tablet_manager.cc:1397] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.003s
I20260811 06:53:39.338013 8340 tablet_bootstrap.cc:492] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: No bootstrap required, opened a new log
I20260811 06:53:39.338290 8340 ts_tablet_manager.cc:1397] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.008s
I20260811 06:53:39.338749 8337 tablet_bootstrap.cc:492] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: No bootstrap required, opened a new log
I20260811 06:53:39.339015 8337 ts_tablet_manager.cc:1397] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20260811 06:53:39.344087 8338 raft_consensus.cc:348] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:39.344432 8338 raft_consensus.cc:374] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:53:39.344547 8338 raft_consensus.cc:729] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecc551bb07e54d43b084e2eca2216b6d, State: Initialized, Role: FOLLOWER
I20260811 06:53:39.345152 8338 consensus_queue.cc:260] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:39.347038 8312 heartbeater.cc:503] Master 127.12.145.62:35133 was elected leader, sending a full tablet report...
I20260811 06:53:39.348500 8340 raft_consensus.cc:348] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:39.348836 8338 ts_tablet_manager.cc:1428] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260811 06:53:39.348922 8340 raft_consensus.cc:374] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:53:39.349016 8340 raft_consensus.cc:729] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8a77457629447fdac451d2f31e9c2be, State: Initialized, Role: FOLLOWER
I20260811 06:53:39.349012 8337 raft_consensus.cc:348] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:39.349406 8337 raft_consensus.cc:374] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:53:39.349510 8337 raft_consensus.cc:729] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7bd4dcf26434e61a135770e4d54c11d, State: Initialized, Role: FOLLOWER
I20260811 06:53:39.349617 8340 consensus_queue.cc:260] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:39.350096 8337 consensus_queue.cc:260] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:39.350800 7892 heartbeater.cc:503] Master 127.12.145.62:35133 was elected leader, sending a full tablet report...
I20260811 06:53:39.351332 8340 ts_tablet_manager.cc:1428] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260811 06:53:39.352567 8099 heartbeater.cc:503] Master 127.12.145.62:35133 was elected leader, sending a full tablet report...
I20260811 06:53:39.353204 8337 ts_tablet_manager.cc:1428] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260811 06:53:39.424734 8346 raft_consensus.cc:482] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:53:39.425045 8346 raft_consensus.cc:504] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:39.426734 8346 leader_election.cc:288] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8a77457629447fdac451d2f31e9c2be (127.12.145.1:41413), d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
I20260811 06:53:39.432350 8330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.427230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:35921 (local address 127.12.145.1:41413)
0811 06:53:39.427411 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.427416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.427435 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:53:39.427669 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.427674 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.427756 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.427850 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:39.428399 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.429104 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.430750 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.431521 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.431663 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.431738 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.431978 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.432102 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 06:53:39.432351 8317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.427144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.12.145.3:35921)
0811 06:53:39.427362 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.427382 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:39.427505 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:39.428055 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:39.428060 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:39.428094 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:39.428247 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.428258 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.429250 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.429254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.430597 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.430613 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.431663 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.431669 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.431835 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.431858 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 06:53:39.431938 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 06:53:39.432075 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":41}
I20260811 06:53:39.433192 8331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.427821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:44663 (local address 127.12.145.2:40493)
0811 06:53:39.428018 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.428023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.428381 (+ 358us) server_negotiation.cc:407] Connection header received
0811 06:53:39.428544 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.428548 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.428606 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.428679 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:53:39.429201 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.429904 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.431546 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.432307 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.432444 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.432511 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.432834 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.432957 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 06:53:39.433270 8352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.427560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:40493 (local address 127.12.145.3:44663)
0811 06:53:39.428270 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.428284 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 06:53:39.428412 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:53:39.428710 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:53:39.428714 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:53:39.428737 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:53:39.429044 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.429054 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.430041 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.430044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.431391 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:53:39.431403 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.432504 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.432510 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:53:39.432678 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.432710 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 06:53:39.432786 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 06:53:39.432911 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":1,"thread_start_us":395,"threads_started":1}
I20260811 06:53:39.433431 7810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "686af7efca894983b0bdbe0da518b913" candidate_uuid: "ecc551bb07e54d43b084e2eca2216b6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8a77457629447fdac451d2f31e9c2be" is_pre_election: true
I20260811 06:53:39.434062 7810 raft_consensus.cc:2454] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc551bb07e54d43b084e2eca2216b6d in term 0.
I20260811 06:53:39.434248 8026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "686af7efca894983b0bdbe0da518b913" candidate_uuid: "ecc551bb07e54d43b084e2eca2216b6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7bd4dcf26434e61a135770e4d54c11d" is_pre_election: true
I20260811 06:53:39.434760 8026 raft_consensus.cc:2454] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecc551bb07e54d43b084e2eca2216b6d in term 0.
I20260811 06:53:39.434793 8141 leader_election.cc:302] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8a77457629447fdac451d2f31e9c2be, ecc551bb07e54d43b084e2eca2216b6d; no voters:
I20260811 06:53:39.435199 8346 raft_consensus.cc:2781] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:53:39.435359 8346 raft_consensus.cc:482] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:53:39.435458 8346 raft_consensus.cc:3037] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:53:39.437875 8346 raft_consensus.cc:504] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:39.438428 8346 leader_election.cc:288] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [CANDIDATE]: Term 1 election: Requested vote from peers a8a77457629447fdac451d2f31e9c2be (127.12.145.1:41413), d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
I20260811 06:53:39.438834 7810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "686af7efca894983b0bdbe0da518b913" candidate_uuid: "ecc551bb07e54d43b084e2eca2216b6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8a77457629447fdac451d2f31e9c2be"
I20260811 06:53:39.438887 8026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "686af7efca894983b0bdbe0da518b913" candidate_uuid: "ecc551bb07e54d43b084e2eca2216b6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7bd4dcf26434e61a135770e4d54c11d"
I20260811 06:53:39.439002 7810 raft_consensus.cc:3037] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:53:39.439075 8026 raft_consensus.cc:3037] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:53:39.441123 7810 raft_consensus.cc:2454] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc551bb07e54d43b084e2eca2216b6d in term 1.
I20260811 06:53:39.441278 8026 raft_consensus.cc:2454] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecc551bb07e54d43b084e2eca2216b6d in term 1.
I20260811 06:53:39.441476 8141 leader_election.cc:302] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8a77457629447fdac451d2f31e9c2be, ecc551bb07e54d43b084e2eca2216b6d; no voters:
I20260811 06:53:39.441808 8346 raft_consensus.cc:2781] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:53:39.442210 8346 raft_consensus.cc:686] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 1 LEADER]: Becoming Leader. State: Replica: ecc551bb07e54d43b084e2eca2216b6d, State: Running, Role: LEADER
I20260811 06:53:39.442741 8346 consensus_queue.cc:237] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:53:39.447345 7566 catalog_manager.cc:5495] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d reported cstate change: term changed from 0 to 1, leader changed from <none> to ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3). New cstate: current_term: 1 leader_uuid: "ecc551bb07e54d43b084e2eca2216b6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } health_report { overall_health: UNKNOWN } } }
W20260811 06:53:39.469143 8313 tablet.cc:2369] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:53:39.496536 8328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.491524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51068 (local address 127.12.145.3:45701)
0811 06:53:39.491714 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.491719 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.491762 (+ 43us) server_negotiation.cc:407] Connection header received
0811 06:53:39.491910 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.491915 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.491997 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.492133 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:53:39.492417 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.493190 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.494549 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.494978 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.495079 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.495492 (+ 413us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:53:39.496016 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:53:39.496140 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.496256 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.496327 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 06:53:39.504521 7810 raft_consensus.cc:1261] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Refusing update from remote peer ecc551bb07e54d43b084e2eca2216b6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:53:39.504514 8026 raft_consensus.cc:1261] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d [term 1 FOLLOWER]: Refusing update from remote peer ecc551bb07e54d43b084e2eca2216b6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:53:39.505419 8355 consensus_queue.cc:1035] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:53:39.505853 8346 consensus_queue.cc:1035] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:53:39.518131 8362 mvcc.cc:205] Tried to move back new op lower bound from 7317222275080892416 to 7317222274841939968. Current Snapshot: MvccSnapshot[applied={T|T < 7317222275080892416}]
I20260811 06:53:39.539850 7568 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:53:39.540146 7568 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:53:39.543762 7568 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Sending DeleteTablet for 3 replicas of tablet 686af7efca894983b0bdbe0da518b913
I20260811 06:53:39.545140 8211 tablet_service.cc:1514] Processing DeleteTablet for tablet 686af7efca894983b0bdbe0da518b913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:53:39 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:51056
I20260811 06:53:39.545229 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 7630
I20260811 06:53:39.545132 7993 tablet_service.cc:1514] Processing DeleteTablet for tablet 686af7efca894983b0bdbe0da518b913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:53:39 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:45962
I20260811 06:53:39.546229 7780 tablet_service.cc:1514] Processing DeleteTablet for tablet 686af7efca894983b0bdbe0da518b913 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:53:39 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:51228
I20260811 06:53:39.557884 8379 tablet_replica.cc:330] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: stopping tablet replica
I20260811 06:53:39.558449 8379 raft_consensus.cc:2229] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:53:39.559103 8379 raft_consensus.cc:2258] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:53:39.563485 8379 ts_tablet_manager.cc:1905] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:53:39.564035 8380 tablet_replica.cc:330] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: stopping tablet replica
I20260811 06:53:39.565115 8330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.546029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51242 (local address 127.12.145.1:41413)
0811 06:53:39.546217 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.546223 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.546246 (+ 23us) server_negotiation.cc:407] Connection header received
0811 06:53:39.546438 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.546444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.546553 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.546660 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:39.548078 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.549249 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.550782 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.551429 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.551568 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.555371 (+ 3803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:39.555389 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:39.555408 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:39.555452 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:39.559778 (+ 4326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.560674 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.560683 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.560687 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.560843 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.561299 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.561305 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.561308 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.562463 (+ 1155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:39.562769 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.564319 (+ 1550us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.564596 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 06:53:39.565394 8378 tablet_replica.cc:330] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: stopping tablet replica
I20260811 06:53:39.564671 8380 raft_consensus.cc:2229] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:53:39.565845 8378 raft_consensus.cc:2229] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:53:39.566284 8380 raft_consensus.cc:2258] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:53:39.566409 7882 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:39.566883 8378 raft_consensus.cc:2258] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:53:39.571393 8378 ts_tablet_manager.cc:1905] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:53:39.574796 8379 ts_tablet_manager.cc:1918] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:53:39.575001 8379 log.cc:1196] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/686af7efca894983b0bdbe0da518b913
I20260811 06:53:39.575664 8379 ts_tablet_manager.cc:1939] T 686af7efca894983b0bdbe0da518b913 P d7bd4dcf26434e61a135770e4d54c11d: Deleting consensus metadata
I20260811 06:53:39.577955 7549 catalog_manager.cc:4841] TS d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493): tablet 686af7efca894983b0bdbe0da518b913 (table test-table [id=f6e79130cc06470e9e7239237a8b8aa2]) successfully deleted
I20260811 06:53:39.579303 8378 ts_tablet_manager.cc:1918] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:53:39.579556 8378 log.cc:1196] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/686af7efca894983b0bdbe0da518b913
I20260811 06:53:39.580183 8378 ts_tablet_manager.cc:1939] T 686af7efca894983b0bdbe0da518b913 P ecc551bb07e54d43b084e2eca2216b6d: Deleting consensus metadata
I20260811 06:53:39.582067 7543 catalog_manager.cc:4841] TS ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701): tablet 686af7efca894983b0bdbe0da518b913 (table test-table [id=f6e79130cc06470e9e7239237a8b8aa2]) successfully deleted
I20260811 06:53:39.667361 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 7630
I20260811 06:53:39.698318 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 7898
W20260811 06:53:39.698264 7549 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.1:41413 (error 108)
I20260811 06:53:39.700387 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.699846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.0.0.1:51246)
0811 06:53:39.700084 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.700199 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
W20260811 06:53:39.700660 7549 catalog_manager.cc:4584] TS a8a77457629447fdac451d2f31e9c2be (127.12.145.1:41413): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 686af7efca894983b0bdbe0da518b913: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41413: connect: Connection refused (error 111)
I20260811 06:53:39.714131 8331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.699815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45964 (local address 127.12.145.2:40493)
0811 06:53:39.700004 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.700011 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.700030 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:53:39.700094 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.700100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.700189 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.700294 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:39.702133 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.702854 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.704710 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.705084 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.705171 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.708499 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:39.708514 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:39.708529 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:39.708565 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:39.711299 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.712097 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.712104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.712107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.712230 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.712626 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.712629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.712630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.713027 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:39.713251 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.713662 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.713857 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:53:39.714931 8089 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:39.754405 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.753868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.0.0.1:51258)
0811 06:53:39.754106 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.754226 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 06:53:39.755649 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.755176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.0.0.1:51270)
0811 06:53:39.755360 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.755465 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 06:53:39.803843 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 7898
I20260811 06:53:39.816815 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.816185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.0.0.1:51274)
0811 06:53:39.816503 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.816618 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181}
I20260811 06:53:39.818254 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.817779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.0.0.1:51276)
0811 06:53:39.818015 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.818104 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260811 06:53:39.835966 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 8107
I20260811 06:53:39.851724 8328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.836761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51082 (local address 127.12.145.3:45701)
0811 06:53:39.836932 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 06:53:39.836936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:53:39.837149 (+ 213us) server_negotiation.cc:407] Connection header received
0811 06:53:39.837312 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:53:39.837318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:53:39.837395 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:53:39.837478 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:53:39.839336 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.840200 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.842101 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:53:39.842538 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:53:39.842640 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:53:39.845963 (+ 3323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:53:39.845975 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:53:39.845992 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:53:39.846032 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:53:39.848865 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.849716 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.849723 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.849725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.849903 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:53:39.850304 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:53:39.850307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:53:39.850309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:53:39.850667 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:53:39.850931 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 06:53:39.851255 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 06:53:39.851418 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 06:53:39.852465 8306 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:39.899195 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.898688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.0.0.1:51288)
0811 06:53:39.898908 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.899010 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 06:53:39.900238 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:39.899854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.0.0.1:51290)
0811 06:53:39.900048 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:39.900121 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 06:53:39.972896 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 8107
I20260811 06:53:39.999188 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 7508
I20260811 06:53:40.000378 7617 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:53:40.111688 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:53:40.111016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41413 (local address 127.0.0.1:51300)
0811 06:53:40.111326 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 06:53:40.111458 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260811 06:53:40.111799 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 7508
I20260811 06:54:00.142143 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35133
--webserver_interface=127.12.145.62
--webserver_port=33359
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:35133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:00.479310 8389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:00.479609 8389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:00.479748 8389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:00.486747 8389 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 06:54:00.486843 8389 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 06:54:00.486907 8389 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 06:54:00.486985 8389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:00.487061 8389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:00.487156 8389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:00.487214 8389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:00.487289 8389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:00.496817 8389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:35133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=33359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:00.498100 8389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:00.499397 8389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:00.510955 8399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:00.511032 8400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:00.511353 8389 server_base.cc:1034] running on GCE node
W20260811 06:54:00.511036 8402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:00.512331 8389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:00.513636 8389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:00.514894 8389 hybrid_clock.cc:648] HybridClock initialized: now 1786431240514834 us; error 34 us; skew 500 ppm
I20260811 06:54:00.515228 8389 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:00 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431240, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:00.518332 8389 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:54:00.519726 8389 webserver.cc:460] Webserver started at http://127.12.145.62:33359/ using document root <none> and password file <none>
I20260811 06:54:00.520433 8389 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:00.520538 8389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:00.525998 8389 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:54:00.528779 8418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:00.530166 8389 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:54:00.530331 8389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "8ff16d4aaf6041dc926361912f4911a3"
format_stamp: "Formatted at 2026-08-11 06:53:14 on dist-test-slave-7lbf"
server_key: "3c3dfac5cdbddd2c516bfde60eea0916"
server_key_iv: "3b88ac31adcaa4c91481ea381d711a3b"
server_key_version: "encryptionkey@0"
I20260811 06:54:00.531278 8389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:00.554831 8389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:00.559115 8389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:00.559403 8389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:00.576459 8389 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:35133
I20260811 06:54:00.576499 8498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:35133 every 8 connection(s)
I20260811 06:54:00.577889 8389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:00.581060 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 8389
I20260811 06:54:00.581943 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:41413
--local_ip_for_outbound_sockets=127.12.145.1
--tserver_master_addrs=127.12.145.62:35133
--webserver_port=37891
--webserver_interface=127.12.145.1
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:54:00.584638 8499 sys_catalog.cc:263] Verifying existing consensus state
I20260811 06:54:00.587828 8499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Bootstrap starting.
I20260811 06:54:00.612605 8499 log.cc:824] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:00.633891 8499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 06:54:00.634589 8499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Bootstrap complete.
I20260811 06:54:00.644304 8499 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:54:00.645197 8499 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff16d4aaf6041dc926361912f4911a3, State: Initialized, Role: FOLLOWER
I20260811 06:54:00.645851 8499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:54:00.646081 8499 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:00.646193 8499 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:00.646354 8499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 2 FOLLOWER]: Advancing to term 3
I20260811 06:54:00.650146 8499 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:54:00.650630 8499 leader_election.cc:302] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ff16d4aaf6041dc926361912f4911a3; no voters:
I20260811 06:54:00.651257 8499 leader_election.cc:288] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 06:54:00.651397 8510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 06:54:00.652593 8510 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [term 3 LEADER]: Becoming Leader. State: Replica: 8ff16d4aaf6041dc926361912f4911a3, State: Running, Role: LEADER
I20260811 06:54:00.653228 8510 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } }
I20260811 06:54:00.653424 8499 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:00.655700 8512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ff16d4aaf6041dc926361912f4911a3. Latest consensus state: current_term: 3 leader_uuid: "8ff16d4aaf6041dc926361912f4911a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } } }
I20260811 06:54:00.656091 8512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:00.656647 8511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "8ff16d4aaf6041dc926361912f4911a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff16d4aaf6041dc926361912f4911a3" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35133 } } }
I20260811 06:54:00.656952 8511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:00.660112 8519 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:00.668399 8519 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:00.669955 8519 catalog_manager.cc:1259] Loaded cluster ID: 51c7251711ad4f438c9387a3322baf1f
I20260811 06:54:00.670105 8519 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:00.674208 8519 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:00.675860 8519 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Loaded TSK: 0
I20260811 06:54:00.676075 8519 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8ff16d4aaf6041dc926361912f4911a3: Loaded TSK: 1
F20260811 06:54:00.677254 8519 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f642dacb9ad google::LogMessage::Fail() at ??:0
@ 0x7f642dace88a google::LogMessage::SendToLog() at ??:0
@ 0x7f642dacb4de google::LogMessage::Flush() at ??:0
@ 0x7f642dacca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f643182f7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f643181e73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f64434fa1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f64434f9783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f64435852a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f64435850c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f64435cf5e9 std::function<>::operator()() at ??:0
@ 0x7f64434fdcdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f64434fbc36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6443583610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f6443583439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6430717345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f643071a91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f643071a799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f64306f5eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f64339cf6db start_thread at ??:0
@ 0x7f642c96561f clone at ??:0
W20260811 06:54:00.994351 8508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:00.994616 8508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:00.994710 8508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:01.001797 8508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:01.001910 8508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:01.002030 8508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:54:01.011569 8508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:41413
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=37891
--tserver_master_addrs=127.12.145.62:35133
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:01.012787 8508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:01.014072 8508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:01.026978 8573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:01.027009 8582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:01.027101 8576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:01.027762 8508 server_base.cc:1034] running on GCE node
I20260811 06:54:01.028342 8508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:01.029258 8508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:01.030453 8508 hybrid_clock.cc:648] HybridClock initialized: now 1786431241030404 us; error 41 us; skew 500 ppm
I20260811 06:54:01.030869 8508 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:01 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431241, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:01.033963 8508 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:54:01.035315 8508 webserver.cc:460] Webserver started at http://127.12.145.1:37891/ using document root <none> and password file <none>
I20260811 06:54:01.035974 8508 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:01.036095 8508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:01.041296 8508 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:54:01.044047 8594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:01.045282 8508 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 06:54:01.045436 8508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "a8a77457629447fdac451d2f31e9c2be"
format_stamp: "Formatted at 2026-08-11 06:53:15 on dist-test-slave-7lbf"
server_key: "8b5bb5c65bafcef3de8ffaceee84187a"
server_key_iv: "ef1f4e08791a3e77f710b421caa5cfd1"
server_key_version: "encryptionkey@0"
I20260811 06:54:01.046415 8508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:01.072546 8508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:01.076651 8508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:01.076929 8508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:01.077957 8508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:01.079821 8610 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260811 06:54:01.085794 8508 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 06:54:01.085928 8508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260811 06:54:01.086047 8508 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 06:54:01.089124 8508 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 06:54:01.089205 8508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20260811 06:54:01.089556 8610 tablet_bootstrap.cc:492] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Bootstrap starting.
I20260811 06:54:01.097707 8610 log.cc:824] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:01.110605 8610 tablet_bootstrap.cc:492] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 06:54:01.111518 8610 tablet_bootstrap.cc:492] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Bootstrap complete.
I20260811 06:54:01.112161 8610 ts_tablet_manager.cc:1397] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.010s
I20260811 06:54:01.125670 8610 raft_consensus.cc:348] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:54:01.127506 8610 raft_consensus.cc:729] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8a77457629447fdac451d2f31e9c2be, State: Initialized, Role: FOLLOWER
I20260811 06:54:01.128657 8610 consensus_queue.cc:260] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:54:01.130880 8610 ts_tablet_manager.cc:1428] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be: Time spent starting tablet: real 0.019s user 0.010s sys 0.005s
I20260811 06:54:01.132483 8508 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:41413
I20260811 06:54:01.132517 8807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:41413 every 8 connection(s)
I20260811 06:54:01.133704 8508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:54:01.138037 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 8508
I20260811 06:54:01.138548 8810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:01.136615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:60641)
0811 06:54:01.137384 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:01.137681 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":309,"threads_started":1}
I20260811 06:54:01.138684 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:40493
--local_ip_for_outbound_sockets=127.12.145.2
--tserver_master_addrs=127.12.145.62:35133
--webserver_port=38841
--webserver_interface=127.12.145.2
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:01.139209 8808 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:35133 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.62:35133: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
I20260811 06:54:01.140040 8810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:01.139709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:50873)
0811 06:54:01.139836 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:01.139939 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 06:54:01.140872 8810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:01.140535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:41127)
0811 06:54:01.140678 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:01.140747 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 06:54:01.141091 8808 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 06:54:01.470815 8811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:01.471077 8811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:01.471197 8811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:01.478238 8811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:01.478343 8811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:01.478482 8811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:54:01.487993 8811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:40493
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=38841
--tserver_master_addrs=127.12.145.62:35133
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:01.489223 8811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:01.490552 8811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:01.503266 8823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:01.503312 8826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:01.503353 8822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:01.504163 8811 server_base.cc:1034] running on GCE node
I20260811 06:54:01.504710 8811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:01.505631 8811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:01.506824 8811 hybrid_clock.cc:648] HybridClock initialized: now 1786431241506790 us; error 61 us; skew 500 ppm
I20260811 06:54:01.507121 8811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:01 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431241, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:01.510172 8811 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:54:01.511603 8811 webserver.cc:460] Webserver started at http://127.12.145.2:38841/ using document root <none> and password file <none>
I20260811 06:54:01.512255 8811 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:01.512382 8811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:01.517608 8811 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:54:01.520185 8836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:01.521413 8811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:54:01.521589 8811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "d7bd4dcf26434e61a135770e4d54c11d"
format_stamp: "Formatted at 2026-08-11 06:53:15 on dist-test-slave-7lbf"
server_key: "8381448d423f71f1c4f1c338892aa0d1"
server_key_iv: "41e4238b2bd7306f5a83167e88b2a60c"
server_key_version: "encryptionkey@0"
I20260811 06:54:01.522552 8811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:01.533941 8811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:01.537940 8811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:01.538192 8811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:01.539157 8811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:01.540478 8811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:01.540572 8811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:01.540679 8811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:01.540753 8811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:01.572755 8811 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:40493
I20260811 06:54:01.572924 9037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:40493 every 8 connection(s)
I20260811 06:54:01.574216 8811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:54:01.577203 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 8811
I20260811 06:54:01.578118 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:45701
--local_ip_for_outbound_sockets=127.12.145.3
--tserver_master_addrs=127.12.145.62:35133
--webserver_port=42107
--webserver_interface=127.12.145.3
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:54:01.579351 9046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:01.577424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:40817)
0811 06:54:01.578232 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:01.578512 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":318,"threads_started":1}
W20260811 06:54:01.579958 9039 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:35133 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.62:35133: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
I20260811 06:54:01.580726 9046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:01.580415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:38421)
0811 06:54:01.580559 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:01.580623 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 06:54:01.581542 9046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:01.581197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:48171)
0811 06:54:01.581339 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:01.581410 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 06:54:01.581750 9039 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 06:54:01.909410 9050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:01.909713 9050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:01.909864 9050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:01.916864 9050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:01.916960 9050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:01.917106 9050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:54:01.926546 9050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:45701
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=42107
--tserver_master_addrs=127.12.145.62:35133
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:01.927901 9050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:01.929260 9050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:01.941908 9057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:01.942020 9062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:01.941860 9058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:01.942850 9050 server_base.cc:1034] running on GCE node
I20260811 06:54:01.943457 9050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:01.944406 9050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:01.945618 9050 hybrid_clock.cc:648] HybridClock initialized: now 1786431241945563 us; error 48 us; skew 500 ppm
I20260811 06:54:01.945940 9050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:01 dist-test-slave-7lbf krb5kdc[6567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431241, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:01.951542 9050 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:54:01.952942 9050 webserver.cc:460] Webserver started at http://127.12.145.3:42107/ using document root <none> and password file <none>
I20260811 06:54:01.953626 9050 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:01.953748 9050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:01.958844 9050 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260811 06:54:01.961602 9074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:01.962869 9050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:54:01.963023 9050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "ecc551bb07e54d43b084e2eca2216b6d"
format_stamp: "Formatted at 2026-08-11 06:53:16 on dist-test-slave-7lbf"
server_key: "1383bd1486aab00436f78d37092eb014"
server_key_iv: "2b70a36a70476a834d85927114582ef9"
server_key_version: "encryptionkey@0"
I20260811 06:54:01.963989 9050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:01.988035 9050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:01.991755 9050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:01.992029 9050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:01.993008 9050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:01.994338 9050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:01.994433 9050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:01.994541 9050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:01.994612 9050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:02.024813 9050 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:45701
I20260811 06:54:02.024879 9263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:45701 every 8 connection(s)
I20260811 06:54:02.026324 9050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:54:02.031060 9266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:02.029118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:51437)
0811 06:54:02.029904 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:02.030161 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":272,"threads_started":1}
W20260811 06:54:02.031652 9264 heartbeater.cc:644] Failed to heartbeat to 127.12.145.62:35133 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.62:35133: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
I20260811 06:54:02.032382 9266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:02.032088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:56115)
0811 06:54:02.032212 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:02.032276 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 06:54:02.033118 9266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:02.032850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:59757)
0811 06:54:02.032952 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:02.033021 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 06:54:02.033336 9264 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 06:54:02.035858 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 9050
I20260811 06:54:02.142309 9268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:02.141616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:45435)
0811 06:54:02.142036 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:02.142112 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":192,"threads_started":1}
I20260811 06:54:02.583029 9269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:02.582253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:55083)
0811 06:54:02.582719 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:02.582798 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":239,"threads_started":1}
I20260811 06:54:02.923178 9270 raft_consensus.cc:482] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:02.923485 9270 raft_consensus.cc:504] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:54:02.925122 9270 leader_election.cc:288] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701), d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
Aug 11 06:54:02 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431241, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
Aug 11 06:54:02 dist-test-slave-7lbf krb5kdc[6567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431241, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:54:02.946494 9283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:02.925900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:60603 (local address 127.12.145.2:40493)
0811 06:54:02.927255 (+ 1355us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:02.927271 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:02.927319 (+ 48us) server_negotiation.cc:407] Connection header received
0811 06:54:02.929297 (+ 1978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:02.929306 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:02.929724 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:02.930008 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:02.932029 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:02.933422 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:02.935154 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:02.935738 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:02.935894 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:02.939901 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:02.939908 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:02.939920 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:02.939958 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:02.942631 (+ 2673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:02.943442 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:02.943448 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:02.943453 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:02.943611 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:02.944122 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:02.944128 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:02.944130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:02.944696 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:02.944846 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:02.945722 (+ 876us) server_negotiation.cc:299] Negotiation successful
0811 06:54:02.946111 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1129,"thread_start_us":951,"threads_started":1}
I20260811 06:54:02.946574 9279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:02.925363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:45701 (local address 127.12.145.1:48747)
0811 06:54:02.925990 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:02.926043 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:02.926778 (+ 735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:02.930198 (+ 3420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:02.930211 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:02.931079 (+ 868us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:02.931839 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:02.931860 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:02.933621 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:02.933625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:02.935011 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:02.935023 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:02.935976 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:02.935984 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:02.936189 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:02.936877 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:02.936907 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:02.939273 (+ 2366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:02.942742 (+ 3469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:02.942751 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:02.942765 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:02.943319 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:02.943775 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:02.943780 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:02.943784 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:02.943988 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:02.945500 (+ 1512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:02.945506 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:02.945717 (+ 211us) client_negotiation.cc:769] Sending connection context
0811 06:54:02.945886 (+ 169us) client_negotiation.cc:240] Negotiation successful
0811 06:54:02.946110 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":112,"spinlock_wait_cycles":22656,"thread_start_us":794,"threads_started":1}
I20260811 06:54:02.946858 9281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:02.925699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:48747 (local address 127.12.145.3:45701)
0811 06:54:02.927434 (+ 1735us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:02.927445 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:02.927476 (+ 31us) server_negotiation.cc:407] Connection header received
0811 06:54:02.929490 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:02.929499 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:02.929870 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:02.930188 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:02.932025 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:02.933463 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:02.935145 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:02.935769 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:02.935960 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:02.939580 (+ 3620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:02.939591 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:02.939607 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:02.939660 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:02.942610 (+ 2950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:02.943439 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:02.943445 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:02.943452 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:02.943668 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:02.944898 (+ 1230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:02.944902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:02.944904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:02.945342 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:02.945495 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:02.946130 (+ 635us) server_negotiation.cc:299] Negotiation successful
0811 06:54:02.946507 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1591,"thread_start_us":1474,"threads_started":1}
I20260811 06:54:02.947098 9273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:02.925403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:40493 (local address 127.12.145.1:60603)
0811 06:54:02.926417 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:02.926436 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:02.927101 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:02.930200 (+ 3099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:02.930211 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:02.931080 (+ 869us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:02.931839 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:02.931860 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:02.933627 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:02.933632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:02.935016 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:02.935028 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:02.935933 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:02.935941 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:02.936191 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:02.936946 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:02.936963 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:02.939620 (+ 2657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:02.942767 (+ 3147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:02.942772 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:02.942775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:02.943286 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:02.943722 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:02.943727 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:02.943730 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:02.943995 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:02.944898 (+ 903us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:02.944905 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:02.945191 (+ 286us) client_negotiation.cc:769] Sending connection context
0811 06:54:02.945465 (+ 274us) client_negotiation.cc:240] Negotiation successful
0811 06:54:02.946004 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"mutex_wait_us":149,"spinlock_wait_cycles":51072,"thread_start_us":289,"threads_started":1}
W20260811 06:54:02.950367 8605 leader_election.cc:341] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493): Not found: Tablet not found: 686af7efca894983b0bdbe0da518b913
W20260811 06:54:02.950740 8595 leader_election.cc:341] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701): Not found: Tablet not found: 686af7efca894983b0bdbe0da518b913
I20260811 06:54:02.950892 8595 leader_election.cc:302] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8a77457629447fdac451d2f31e9c2be; no voters: d7bd4dcf26434e61a135770e4d54c11d, ecc551bb07e54d43b084e2eca2216b6d
I20260811 06:54:02.951327 9270 raft_consensus.cc:2726] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:54:03.034662 9284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:03.033800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:45519)
0811 06:54:03.034283 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:03.034431 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":222,"threads_started":1}
I20260811 06:54:03.143505 9273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:03.143131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:50915)
0811 06:54:03.143281 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:03.143373 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 06:54:03.584517 9285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:03.583846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:34701)
0811 06:54:03.584279 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:03.584358 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":247,"threads_started":1}
I20260811 06:54:04.036186 9286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:04.035497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:37745)
0811 06:54:04.035933 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:04.036023 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":218,"threads_started":1}
I20260811 06:54:04.144966 9290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:04.144293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:42609)
0811 06:54:04.144728 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:04.144810 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":217,"threads_started":1}
I20260811 06:54:04.586081 9291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:04.585369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:49373)
0811 06:54:04.585819 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:04.585900 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":254,"threads_started":1}
I20260811 06:54:04.617369 9292 raft_consensus.cc:482] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:04.617626 9292 raft_consensus.cc:504] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:54:04.618320 9292 leader_election.cc:288] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701), d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
W20260811 06:54:04.619242 8595 leader_election.cc:341] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701): Not found: Tablet not found: 686af7efca894983b0bdbe0da518b913
W20260811 06:54:04.619413 8605 leader_election.cc:341] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493): Not found: Tablet not found: 686af7efca894983b0bdbe0da518b913
I20260811 06:54:04.619609 8605 leader_election.cc:302] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8a77457629447fdac451d2f31e9c2be; no voters: d7bd4dcf26434e61a135770e4d54c11d, ecc551bb07e54d43b084e2eca2216b6d
I20260811 06:54:04.619889 9292 raft_consensus.cc:2726] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:54:05.037845 9300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:05.037097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:47019)
0811 06:54:05.037604 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:05.037688 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":257,"threads_started":1}
I20260811 06:54:05.146623 9301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:05.145856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:43021)
0811 06:54:05.146346 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:05.146435 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":263,"threads_started":1}
I20260811 06:54:05.587729 9303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:05.587019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:32867)
0811 06:54:05.587441 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:05.587546 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":205,"threads_started":1}
I20260811 06:54:06.039415 9304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:06.038732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:39177)
0811 06:54:06.039156 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:06.039235 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":216,"threads_started":1}
I20260811 06:54:06.138549 9305 raft_consensus.cc:482] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:06.138754 9305 raft_consensus.cc:504] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:54:06.139503 9305 leader_election.cc:288] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701), d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
W20260811 06:54:06.140527 8605 leader_election.cc:341] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493): Not found: Tablet not found: 686af7efca894983b0bdbe0da518b913
W20260811 06:54:06.140708 8595 leader_election.cc:341] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701): Not found: Tablet not found: 686af7efca894983b0bdbe0da518b913
I20260811 06:54:06.140846 8595 leader_election.cc:302] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8a77457629447fdac451d2f31e9c2be; no voters: d7bd4dcf26434e61a135770e4d54c11d, ecc551bb07e54d43b084e2eca2216b6d
I20260811 06:54:06.141088 9305 raft_consensus.cc:2726] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:54:06.148404 9306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:06.147529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:43227)
0811 06:54:06.148060 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:06.148180 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":221,"threads_started":1}
I20260811 06:54:06.589395 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:06.588653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:46351)
0811 06:54:06.589118 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:06.589205 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":244,"threads_started":1}
I20260811 06:54:07.040938 9311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:07.040273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:34099)
0811 06:54:07.040690 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:07.040771 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":217,"threads_started":1}
I20260811 06:54:07.150068 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:07.149255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:55711)
0811 06:54:07.149717 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:07.149878 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":202,"threads_started":1}
I20260811 06:54:07.591042 9313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:07.590285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:52781)
0811 06:54:07.590763 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:07.590844 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":265,"threads_started":1}
I20260811 06:54:08.042601 9314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:08.041885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:59419)
0811 06:54:08.042343 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:08.042425 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":239,"threads_started":1}
I20260811 06:54:08.151737 9315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:08.150991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:47501)
0811 06:54:08.151420 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:08.151506 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":214,"threads_started":1}
I20260811 06:54:08.486881 9317 raft_consensus.cc:482] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:08.487108 9317 raft_consensus.cc:504] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:54:08.487772 9317 leader_election.cc:288] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701), d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
W20260811 06:54:08.488786 8605 leader_election.cc:341] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493): Not found: Tablet not found: 686af7efca894983b0bdbe0da518b913
W20260811 06:54:08.488948 8595 leader_election.cc:341] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701): Not found: Tablet not found: 686af7efca894983b0bdbe0da518b913
I20260811 06:54:08.489066 8595 leader_election.cc:302] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8a77457629447fdac451d2f31e9c2be; no voters: d7bd4dcf26434e61a135770e4d54c11d, ecc551bb07e54d43b084e2eca2216b6d
I20260811 06:54:08.489287 9317 raft_consensus.cc:2726] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:54:08.593060 9318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:08.592058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:51271)
0811 06:54:08.592709 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:08.592856 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":323,"threads_started":1}
I20260811 06:54:09.044260 9322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:09.043487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:53763)
0811 06:54:09.043995 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:09.044078 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":225,"threads_started":1}
I20260811 06:54:09.153306 9324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:09.152587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:59435)
0811 06:54:09.153051 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:09.153134 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":253,"threads_started":1}
I20260811 06:54:09.594730 9325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:09.594024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:56569)
0811 06:54:09.594461 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:09.594554 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":232,"threads_started":1}
I20260811 06:54:10.045840 9327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:10.045120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:45771)
0811 06:54:10.045563 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:10.045657 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":206,"threads_started":1}
I20260811 06:54:10.154834 9328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:10.154103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:52589)
0811 06:54:10.154532 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:10.154626 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":225,"threads_started":1}
I20260811 06:54:10.596616 9330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:10.595662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:36929)
0811 06:54:10.596337 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:10.596446 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":301,"threads_started":1}
I20260811 06:54:11.047487 9331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:11.046748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:56299)
0811 06:54:11.047227 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:11.047317 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":245,"threads_started":1}
I20260811 06:54:11.156425 9332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:11.155726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:60549)
0811 06:54:11.156149 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:11.156235 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":228,"threads_started":1}
I20260811 06:54:11.598255 9333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:11.597507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:52817)
0811 06:54:11.598001 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:11.598085 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":225,"threads_started":1}
I20260811 06:54:12.049113 9334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:12.048358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:41749)
0811 06:54:12.048830 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:12.048927 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":238,"threads_started":1}
I20260811 06:54:12.158051 9335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:12.157252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:50275)
0811 06:54:12.157734 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:12.157861 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":254,"threads_started":1}
I20260811 06:54:12.599879 9337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:12.599116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:38725)
0811 06:54:12.599616 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:12.599700 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":254,"threads_started":1}
I20260811 06:54:13.050777 9338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:13.049982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:44051)
0811 06:54:13.050502 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:13.050616 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":270,"threads_started":1}
I20260811 06:54:13.159570 9341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:13.158882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:44001)
0811 06:54:13.159308 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:13.159400 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":202,"threads_started":1}
I20260811 06:54:13.470546 9343 raft_consensus.cc:482] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:13.470753 9343 raft_consensus.cc:504] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecc551bb07e54d43b084e2eca2216b6d" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 45701 } } peers { permanent_uuid: "a8a77457629447fdac451d2f31e9c2be" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41413 } } peers { permanent_uuid: "d7bd4dcf26434e61a135770e4d54c11d" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 40493 } }
I20260811 06:54:13.471541 9343 leader_election.cc:288] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701), d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493)
W20260811 06:54:13.472487 8595 leader_election.cc:341] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ecc551bb07e54d43b084e2eca2216b6d (127.12.145.3:45701): Not found: Tablet not found: 686af7efca894983b0bdbe0da518b913
W20260811 06:54:13.472641 8605 leader_election.cc:341] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7bd4dcf26434e61a135770e4d54c11d (127.12.145.2:40493): Not found: Tablet not found: 686af7efca894983b0bdbe0da518b913
I20260811 06:54:13.472754 8605 leader_election.cc:302] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8a77457629447fdac451d2f31e9c2be; no voters: d7bd4dcf26434e61a135770e4d54c11d, ecc551bb07e54d43b084e2eca2216b6d
I20260811 06:54:13.472990 9343 raft_consensus.cc:2726] T 686af7efca894983b0bdbe0da518b913 P a8a77457629447fdac451d2f31e9c2be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:54:13.601680 9344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:13.600744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:54573)
0811 06:54:13.601326 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:13.601443 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":308,"threads_started":1}
I20260811 06:54:14.052357 9346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:14.051620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:50659)
0811 06:54:14.052111 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:14.052193 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":276,"threads_started":1}
I20260811 06:54:14.161134 9347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:14.160410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:52607)
0811 06:54:14.160871 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:14.160960 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":213,"threads_started":1}
I20260811 06:54:14.603390 9349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:14.602590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:59529)
0811 06:54:14.603090 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:14.603203 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":254,"threads_started":1}
I20260811 06:54:15.053933 9352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:15.053145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:35319)
0811 06:54:15.053659 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:15.053760 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":241,"threads_started":1}
I20260811 06:54:15.162703 9353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:15.161962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:43971)
0811 06:54:15.162423 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:15.162511 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":248,"threads_started":1}
I20260811 06:54:15.605075 9354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:15.604176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:46723)
0811 06:54:15.604681 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:15.604854 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":284,"threads_started":1}
I20260811 06:54:16.055575 9355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:16.054811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:49895)
0811 06:54:16.055288 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:16.055371 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":242,"threads_started":1}
I20260811 06:54:16.164597 9357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:16.163903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.1:56755)
0811 06:54:16.164338 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:16.164421 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":218,"threads_started":1}
I20260811 06:54:16.606982 9358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:16.606274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.2:48843)
0811 06:54:16.606727 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:16.606819 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":225,"threads_started":1}
I20260811 06:54:17.046959 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 8508
I20260811 06:54:17.057327 9360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:17.056583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35133 (local address 127.12.145.3:48069)
0811 06:54:17.057050 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:17.057155 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.62:35133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":252,"threads_started":1}
I20260811 06:54:17.066709 9359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:17.047949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55556 (local address 127.12.145.1:41413)
0811 06:54:17.048463 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:17.048472 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:17.048499 (+ 27us) server_negotiation.cc:407] Connection header received
0811 06:54:17.048562 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:17.048568 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:17.048781 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:17.048948 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:17.050767 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:17.051810 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:17.052997 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:17.053565 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:17.053664 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:17.061198 (+ 7534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:17.061214 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:17.061229 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:17.061266 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:17.064156 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:17.064835 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:17.064842 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:17.064845 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:17.064974 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:17.065250 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:17.065253 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:17.065255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:17.065638 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:17.065921 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:17.066168 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 06:54:17.066373 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":241,"threads_started":1}
I20260811 06:54:17.068028 8797 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:17.156561 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 8508
I20260811 06:54:17.184252 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 8811
I20260811 06:54:17.197309 9364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:17.185062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50128 (local address 127.12.145.2:40493)
0811 06:54:17.185561 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:17.185566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:17.185583 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:54:17.185640 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:17.185644 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:17.185705 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:17.185791 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:17.187128 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:17.187929 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:17.189168 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:17.189714 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:17.189816 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:17.192307 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:17.192312 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:17.192315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:17.192348 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:17.194982 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:17.195677 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:17.195682 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:17.195684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:17.195806 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:17.196149 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:17.196152 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:17.196154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:17.196405 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:17.196606 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:17.196848 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 06:54:17.197015 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":264,"threads_started":1}
I20260811 06:54:17.198236 9028 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:17.282191 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 8811
I20260811 06:54:17.305999 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 9050
I20260811 06:54:17.319554 9368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:17.306795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49754 (local address 127.12.145.3:45701)
0811 06:54:17.307352 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:17.307357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:17.307372 (+ 15us) server_negotiation.cc:407] Connection header received
0811 06:54:17.307428 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:17.307432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:17.307505 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:17.307602 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:17.309035 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:17.309882 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:17.311104 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:17.311537 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:17.311650 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:17.314402 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:17.314407 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:17.314410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:17.314442 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:17.316930 (+ 2488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:17.317610 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:17.317616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:17.317620 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:17.317782 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:17.318144 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:17.318148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:17.318151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:17.318403 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:17.318665 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:17.318952 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 06:54:17.319175 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":273,"threads_started":1}
I20260811 06:54:17.320289 9257 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:17.403023 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 9050
2026-08-11T06:54:17Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64579 ms)
[----------] 30 tests from SecurityITest (331793 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:17 dist-test-slave-7lbf krb5kdc[9373](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:17 dist-test-slave-7lbf krb5kdc[9373](info): set up 2 sockets
Aug 11 06:54:17 dist-test-slave-7lbf krb5kdc[9373](info): commencing operation
krb5kdc: starting...
W20260811 06:54:18.673596 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.002s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:18 dist-test-slave-7lbf krb5kdc[9373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:54:18.957178 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:42477
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:42477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:19.295492 9391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:19.295760 9391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:19.295897 9391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:19.302961 9391 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:19.303063 9391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:19.303138 9391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:19.303211 9391 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:19.303272 9391 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:19.312810 9391 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:42477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:42477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:19.314111 9391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:19.315411 9391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:19.326712 9399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:19.326689 9402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:19.326646 9404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:19.327819 9391 server_base.cc:1034] running on GCE node
I20260811 06:54:19.328580 9391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:19.330010 9391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:19.331214 9391 hybrid_clock.cc:648] HybridClock initialized: now 1786431259331162 us; error 45 us; skew 500 ppm
I20260811 06:54:19.331545 9391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:19 dist-test-slave-7lbf krb5kdc[9373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431259, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:19.334579 9391 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:54:19.335983 9391 webserver.cc:460] Webserver started at http://127.12.145.62:40205/ using document root <none> and password file <none>
I20260811 06:54:19.336676 9391 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:19.336793 9391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:19.337086 9391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:19.340058 9391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "0185106fbca94c49ada1e1046ca06261"
format_stamp: "Formatted at 2026-08-11 06:54:19 on dist-test-slave-7lbf"
server_key: "54c3ab15c07b57a750219b538ae73045"
server_key_iv: "6c55af7b5733ee78ca46c35eecf8db24"
server_key_version: "encryptionkey@0"
I20260811 06:54:19.340786 9391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "0185106fbca94c49ada1e1046ca06261"
format_stamp: "Formatted at 2026-08-11 06:54:19 on dist-test-slave-7lbf"
server_key: "54c3ab15c07b57a750219b538ae73045"
server_key_iv: "6c55af7b5733ee78ca46c35eecf8db24"
server_key_version: "encryptionkey@0"
I20260811 06:54:19.345852 9391 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 06:54:19.349283 9412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:19.350621 9391 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:54:19.350785 9391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "0185106fbca94c49ada1e1046ca06261"
format_stamp: "Formatted at 2026-08-11 06:54:19 on dist-test-slave-7lbf"
server_key: "54c3ab15c07b57a750219b538ae73045"
server_key_iv: "6c55af7b5733ee78ca46c35eecf8db24"
server_key_version: "encryptionkey@0"
I20260811 06:54:19.350970 9391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:19.364486 9391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:19.368417 9391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:19.368674 9391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:19.386261 9391 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:42477
I20260811 06:54:19.386281 9491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:42477 every 8 connection(s)
I20260811 06:54:19.387647 9391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:19.391511 9492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:19.393114 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 9391
I20260811 06:54:19.393356 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:19.394250 12868 external_mini_cluster.cc:1428] Setting key 7ee9813fea517d8d7a0bb179a0cd1a6f
I20260811 06:54:19.404750 9492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261: Bootstrap starting.
I20260811 06:54:19.407977 9492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261: Neither blocks nor log segments found. Creating new log.
Aug 11 06:54:19 dist-test-slave-7lbf krb5kdc[9373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:19.409334 9492 log.cc:824] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:19.412461 9492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261: No bootstrap required, opened a new log
I20260811 06:54:19.416755 9497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:19.396481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55492 (local address 127.12.145.62:42477)
0811 06:54:19.397267 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:19.397279 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:19.397325 (+ 46us) server_negotiation.cc:407] Connection header received
0811 06:54:19.398975 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:19.399001 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:19.399389 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:19.399736 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:19.401220 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:19.402710 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:19.404072 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:19.404752 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:19.404927 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:19.409342 (+ 4415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:19.409350 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:19.409363 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:19.409401 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:19.412598 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:19.413427 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:19.413433 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:19.413439 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:19.413637 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:19.414071 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:19.414074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:19.414076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:19.414604 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:19.414838 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:19.415361 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 06:54:19.415711 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":359,"threads_started":1}
I20260811 06:54:19.420811 9492 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0185106fbca94c49ada1e1046ca06261" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42477 } }
I20260811 06:54:19.421145 9492 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:19.421244 9492 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0185106fbca94c49ada1e1046ca06261, State: Initialized, Role: FOLLOWER
I20260811 06:54:19.421819 9492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0185106fbca94c49ada1e1046ca06261" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42477 } }
I20260811 06:54:19.422040 9492 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:19.422166 9492 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:19.422315 9492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:19.424438 9492 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0185106fbca94c49ada1e1046ca06261" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42477 } }
I20260811 06:54:19.424933 9492 leader_election.cc:302] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0185106fbca94c49ada1e1046ca06261; no voters:
I20260811 06:54:19.425462 9492 leader_election.cc:288] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:19.425616 9500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:19.426270 9500 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [term 1 LEADER]: Becoming Leader. State: Replica: 0185106fbca94c49ada1e1046ca06261, State: Running, Role: LEADER
I20260811 06:54:19.426761 9500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0185106fbca94c49ada1e1046ca06261" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42477 } }
I20260811 06:54:19.427539 9492 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:19.429545 9503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0185106fbca94c49ada1e1046ca06261. Latest consensus state: current_term: 1 leader_uuid: "0185106fbca94c49ada1e1046ca06261" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0185106fbca94c49ada1e1046ca06261" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42477 } } }
I20260811 06:54:19.429755 9502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0185106fbca94c49ada1e1046ca06261" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0185106fbca94c49ada1e1046ca06261" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42477 } } }
I20260811 06:54:19.430037 9503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:19.430156 9502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:19.431425 9512 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:19.436273 9512 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:19.446743 9512 catalog_manager.cc:1347] Generated new cluster ID: 9c48a5efdbb04be7be7b09dbaa1f2994
I20260811 06:54:19.446862 9512 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:19.477083 9512 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:19.479031 9512 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:19.485260 9512 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261: Generated new TSK 0
I20260811 06:54:19.486331 9512 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:54:19.554700 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42477
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:19.886503 9540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:19.886869 9540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:19.887024 9540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:19.894181 9540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:19.894279 9540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:19.894439 9540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:54:19.903865 9540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42477
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:19.905066 9540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:19.906352 9540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:19.918905 9545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:19.918979 9546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:19.918952 9549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:19.919734 9540 server_base.cc:1034] running on GCE node
I20260811 06:54:19.920302 9540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:19.921166 9540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:19.922361 9540 hybrid_clock.cc:648] HybridClock initialized: now 1786431259922309 us; error 47 us; skew 500 ppm
I20260811 06:54:19.922637 9540 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:19 dist-test-slave-7lbf krb5kdc[9373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431259, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:19.925678 9540 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:54:19.927042 9540 webserver.cc:460] Webserver started at http://127.12.145.1:42669/ using document root <none> and password file <none>
I20260811 06:54:19.927692 9540 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:19.927819 9540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:19.928148 9540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:19.931071 9540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "c3caca25aa4b4ad3b381663d642d1723"
format_stamp: "Formatted at 2026-08-11 06:54:19 on dist-test-slave-7lbf"
server_key: "e6da423a09da57ca9a6d5df8bea970e2"
server_key_iv: "8c8d6977eae4940d34371fcb5e307318"
server_key_version: "encryptionkey@0"
I20260811 06:54:19.931871 9540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "c3caca25aa4b4ad3b381663d642d1723"
format_stamp: "Formatted at 2026-08-11 06:54:19 on dist-test-slave-7lbf"
server_key: "e6da423a09da57ca9a6d5df8bea970e2"
server_key_iv: "8c8d6977eae4940d34371fcb5e307318"
server_key_version: "encryptionkey@0"
I20260811 06:54:19.936923 9540 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:54:19.940217 9556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:19.941497 9540 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 06:54:19.941679 9540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "c3caca25aa4b4ad3b381663d642d1723"
format_stamp: "Formatted at 2026-08-11 06:54:19 on dist-test-slave-7lbf"
server_key: "e6da423a09da57ca9a6d5df8bea970e2"
server_key_iv: "8c8d6977eae4940d34371fcb5e307318"
server_key_version: "encryptionkey@0"
I20260811 06:54:19.941861 9540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:19.971037 9540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:19.974972 9540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:19.975229 9540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:19.976181 9540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:19.977500 9540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:19.977613 9540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:19.977737 9540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:19.977813 9540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:20.008518 9540 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:39519
I20260811 06:54:20.008561 9730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:39519 every 8 connection(s)
I20260811 06:54:20.009815 9540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:54:20.014631 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 9540
I20260811 06:54:20.014851 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:54:20.015655 12868 external_mini_cluster.cc:1428] Setting key ccf0681023f07de0b04777d294835ac8
Aug 11 06:54:20 dist-test-slave-7lbf krb5kdc[9373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431259, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:20.031297 9736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:20.012273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:58813 (local address 127.12.145.62:42477)
0811 06:54:20.012729 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:20.012733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:20.013576 (+ 843us) server_negotiation.cc:407] Connection header received
0811 06:54:20.016028 (+ 2452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:20.016033 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:20.016103 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:20.016201 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:20.017990 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:20.018714 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:20.020874 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:20.021286 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:20.021393 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:20.025331 (+ 3938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:20.025337 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:20.025340 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:20.025372 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:20.027915 (+ 2543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:20.028764 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:20.028767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:20.028770 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:20.028928 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:20.029351 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:20.029354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:20.029356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:20.029642 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:20.029754 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:20.030684 (+ 930us) server_negotiation.cc:299] Negotiation successful
0811 06:54:20.030929 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":245,"threads_started":1}
I20260811 06:54:20.031939 9737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:20.012713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:42477 (local address 127.12.145.1:58813)
0811 06:54:20.013397 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:20.013441 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:20.015691 (+ 2250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:20.016444 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:20.016452 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:20.017083 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:20.017805 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:20.017832 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:20.018879 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:20.018884 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:20.020719 (+ 1835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:20.020734 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:20.021543 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:20.021551 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:20.021826 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:20.022502 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:20.022530 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:20.025108 (+ 2578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:20.028055 (+ 2947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:20.028064 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:20.028079 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:20.028662 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:20.029024 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:20.029028 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:20.029031 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:20.029260 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:20.029754 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:20.029762 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:20.030159 (+ 397us) client_negotiation.cc:769] Sending connection context
0811 06:54:20.030437 (+ 278us) client_negotiation.cc:240] Negotiation successful
0811 06:54:20.030860 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":284,"threads_started":1}
I20260811 06:54:20.033396 9731 heartbeater.cc:347] Connected to a master server at 127.12.145.62:42477
I20260811 06:54:20.033711 9731 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:20.034415 9731 heartbeater.cc:511] Master 127.12.145.62:42477 requested a full tablet report, sending...
I20260811 06:54:20.036460 9439 ts_manager.cc:194] Registered new tserver with Master: c3caca25aa4b4ad3b381663d642d1723 (127.12.145.1:39519)
I20260811 06:54:20.037930 9439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:58813
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:54:20.078475 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42477
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:20.410843 9742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:20.411136 9742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:20.411295 9742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:20.418723 9742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:20.418866 9742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:20.419044 9742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:54:20.429041 9742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42477
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:20.430342 9742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:20.431727 9742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:20.445004 9747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:20.444942 9748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:20.445011 9752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:20.445914 9742 server_base.cc:1034] running on GCE node
I20260811 06:54:20.446501 9742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:20.447418 9742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:20.448653 9742 hybrid_clock.cc:648] HybridClock initialized: now 1786431260448598 us; error 32 us; skew 500 ppm
I20260811 06:54:20.449026 9742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:20 dist-test-slave-7lbf krb5kdc[9373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431260, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:20.452105 9742 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:54:20.453462 9742 webserver.cc:460] Webserver started at http://127.12.145.2:41585/ using document root <none> and password file <none>
I20260811 06:54:20.454164 9742 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:20.454282 9742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:20.454576 9742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:20.457355 9742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "d5ad663aa80d45b29fa81cc8f1229f64"
format_stamp: "Formatted at 2026-08-11 06:54:20 on dist-test-slave-7lbf"
server_key: "4ec7c2e0851ebfd4b4953c8dabe8e4a8"
server_key_iv: "e0c4c16710b5387a902982ce93f62563"
server_key_version: "encryptionkey@0"
I20260811 06:54:20.458134 9742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "d5ad663aa80d45b29fa81cc8f1229f64"
format_stamp: "Formatted at 2026-08-11 06:54:20 on dist-test-slave-7lbf"
server_key: "4ec7c2e0851ebfd4b4953c8dabe8e4a8"
server_key_iv: "e0c4c16710b5387a902982ce93f62563"
server_key_version: "encryptionkey@0"
I20260811 06:54:20.463063 9742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260811 06:54:20.466351 9761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:20.467633 9742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:54:20.467782 9742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "d5ad663aa80d45b29fa81cc8f1229f64"
format_stamp: "Formatted at 2026-08-11 06:54:20 on dist-test-slave-7lbf"
server_key: "4ec7c2e0851ebfd4b4953c8dabe8e4a8"
server_key_iv: "e0c4c16710b5387a902982ce93f62563"
server_key_version: "encryptionkey@0"
I20260811 06:54:20.468000 9742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:20.486496 9742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:20.490304 9742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:20.490578 9742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:20.491477 9742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:20.492846 9742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:20.492924 9742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:20.493053 9742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:20.493108 9742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:20.523474 9742 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:46837
I20260811 06:54:20.523506 9948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:46837 every 8 connection(s)
I20260811 06:54:20.524740 9742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:54:20.533269 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 9742
I20260811 06:54:20.533471 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:54:20.534076 12868 external_mini_cluster.cc:1428] Setting key 64ede8caaf3495fe9ebf16a781c2ce82
Aug 11 06:54:20 dist-test-slave-7lbf krb5kdc[9373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431260, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:20.545115 9736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:20.527260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:52759 (local address 127.12.145.62:42477)
0811 06:54:20.527488 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:20.527494 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:20.528701 (+ 1207us) server_negotiation.cc:407] Connection header received
0811 06:54:20.530548 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:20.530553 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:20.530625 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:20.530713 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:20.532178 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:20.532958 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:20.535122 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:20.535662 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:20.535765 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:20.539574 (+ 3809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:20.539579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:20.539582 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:20.539615 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:20.542105 (+ 2490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:20.542910 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:20.542914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:20.542916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:20.543038 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:20.543475 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:20.543478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:20.543480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:20.543732 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:20.543844 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:20.544606 (+ 762us) server_negotiation.cc:299] Negotiation successful
0811 06:54:20.544771 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 06:54:20.546402 9952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:20.527779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:42477 (local address 127.12.145.2:52759)
0811 06:54:20.528549 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:20.528597 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:20.530282 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:20.530909 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:20.530916 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:20.531430 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:20.531987 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:20.532005 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:20.533139 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:20.533144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:20.534990 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:20.535003 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:20.535882 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:20.535888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:20.536191 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:20.536830 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:20.536858 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:20.539333 (+ 2475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:20.542239 (+ 2906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:20.542247 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:20.542263 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:20.542812 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:20.543132 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:20.543136 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:20.543139 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:20.543375 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:20.543855 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:20.543863 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:20.544259 (+ 396us) client_negotiation.cc:769] Sending connection context
0811 06:54:20.544542 (+ 283us) client_negotiation.cc:240] Negotiation successful
0811 06:54:20.545071 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":265,"threads_started":1}
I20260811 06:54:20.547699 9949 heartbeater.cc:347] Connected to a master server at 127.12.145.62:42477
I20260811 06:54:20.547986 9949 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:20.548698 9949 heartbeater.cc:511] Master 127.12.145.62:42477 requested a full tablet report, sending...
I20260811 06:54:20.550118 9439 ts_manager.cc:194] Registered new tserver with Master: d5ad663aa80d45b29fa81cc8f1229f64 (127.12.145.2:46837)
I20260811 06:54:20.550945 9439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:52759
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:54:20.600138 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42477
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:20.933498 9956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:20.933761 9956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:20.933897 9956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:20.941017 9956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:20.941120 9956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:20.941264 9956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:54:20.950714 9956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:42477
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:20.951864 9956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:20.953090 9956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:20.965682 9964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:20.965752 9963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:20.965888 9968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:20.966571 9956 server_base.cc:1034] running on GCE node
I20260811 06:54:20.967168 9956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:20.968051 9956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:20.969254 9956 hybrid_clock.cc:648] HybridClock initialized: now 1786431260969202 us; error 46 us; skew 500 ppm
I20260811 06:54:20.969610 9956 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:20 dist-test-slave-7lbf krb5kdc[9373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431260, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:20.972710 9956 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:54:20.974105 9956 webserver.cc:460] Webserver started at http://127.12.145.3:43091/ using document root <none> and password file <none>
I20260811 06:54:20.974741 9956 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:20.974872 9956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:20.975167 9956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:20.978070 9956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "97114e3a19054a159da88f538b9b53c5"
format_stamp: "Formatted at 2026-08-11 06:54:20 on dist-test-slave-7lbf"
server_key: "29d4043916ca874f1a1249700ddd685c"
server_key_iv: "fcec8e6d7234b8f4718e8525fcb1a508"
server_key_version: "encryptionkey@0"
I20260811 06:54:20.978889 9956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "97114e3a19054a159da88f538b9b53c5"
format_stamp: "Formatted at 2026-08-11 06:54:20 on dist-test-slave-7lbf"
server_key: "29d4043916ca874f1a1249700ddd685c"
server_key_iv: "fcec8e6d7234b8f4718e8525fcb1a508"
server_key_version: "encryptionkey@0"
I20260811 06:54:20.983927 9956 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:54:20.987423 9978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:20.988746 9956 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:54:20.988951 9956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "97114e3a19054a159da88f538b9b53c5"
format_stamp: "Formatted at 2026-08-11 06:54:20 on dist-test-slave-7lbf"
server_key: "29d4043916ca874f1a1249700ddd685c"
server_key_iv: "fcec8e6d7234b8f4718e8525fcb1a508"
server_key_version: "encryptionkey@0"
I20260811 06:54:20.989128 9956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:21.005124 9956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:21.009347 9956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:21.009694 9956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:21.010833 9956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:21.012476 9956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:21.012564 9956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:21.012682 9956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:21.012737 9956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:21.040701 9731 heartbeater.cc:503] Master 127.12.145.62:42477 was elected leader, sending a full tablet report...
I20260811 06:54:21.043947 9956 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:44351
I20260811 06:54:21.043984 10178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:44351 every 8 connection(s)
I20260811 06:54:21.045235 9956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:54:21.047890 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 9956
I20260811 06:54:21.048089 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:54:21.048571 12868 external_mini_cluster.cc:1428] Setting key 03fe2e133ce0ad653038635a27f74276
Aug 11 06:54:21 dist-test-slave-7lbf krb5kdc[9373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431260, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:21.064855 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.047737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:50993 (local address 127.12.145.62:42477)
0811 06:54:21.048266 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.048272 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.049322 (+ 1050us) server_negotiation.cc:407] Connection header received
0811 06:54:21.051540 (+ 2218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.051545 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.051624 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.051712 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:21.053173 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.054029 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.055607 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.056025 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.056134 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.059482 (+ 3348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:21.059487 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:21.059490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:21.059523 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:21.061879 (+ 2356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:21.062556 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:21.062561 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:21.062563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:21.062691 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:21.063116 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:21.063120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:21.063122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:21.063404 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:21.063548 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.064243 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.064474 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":264,"threads_started":1}
I20260811 06:54:21.065865 10184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.048334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:42477 (local address 127.12.145.3:50993)
0811 06:54:21.049169 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.049221 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:21.051275 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:21.051973 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:21.051981 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:21.052474 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:21.053018 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.053035 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.054197 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.054202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.055471 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.055484 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.056238 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.056246 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.056475 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.057058 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:21.057080 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:21.059267 (+ 2187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:21.062011 (+ 2744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:21.062021 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:21.062035 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:21.062440 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:21.062798 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:21.062802 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:21.062805 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:21.063004 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:21.063539 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:21.063547 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:21.063884 (+ 337us) client_negotiation.cc:769] Sending connection context
0811 06:54:21.064151 (+ 267us) client_negotiation.cc:240] Negotiation successful
0811 06:54:21.064683 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":308,"threads_started":1}
I20260811 06:54:21.067111 10179 heartbeater.cc:347] Connected to a master server at 127.12.145.62:42477
I20260811 06:54:21.067371 10179 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:21.068059 10179 heartbeater.cc:511] Master 127.12.145.62:42477 requested a full tablet report, sending...
I20260811 06:54:21.069375 9439 ts_manager.cc:194] Registered new tserver with Master: 97114e3a19054a159da88f538b9b53c5 (127.12.145.3:44351)
I20260811 06:54:21.070194 9439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:50993
I20260811 06:54:21.075862 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:54:21.092039 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.080505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55494 (local address 127.12.145.62:42477)
0811 06:54:21.080668 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.080672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.081070 (+ 398us) server_negotiation.cc:407] Connection header received
0811 06:54:21.081207 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.081210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.081282 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.081360 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:21.082762 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.083460 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.084671 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.085083 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.085176 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.087382 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:21.087387 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:21.087390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:21.087431 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:21.089924 (+ 2493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:21.090479 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:21.090483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:21.090485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:21.090615 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:21.090888 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:21.090891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:21.090893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:21.091189 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:21.091363 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.091600 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.091763 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 06:54:21.095834 9439 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55494:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:54:21.102638 9439 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:54:21.137303 10198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.114208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:44351 (local address 127.0.0.1:35414)
0811 06:54:21.126001 (+ 11793us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.126059 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:21.126263 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:21.129828 (+ 3565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:21.129837 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:21.129871 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:21.130265 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.130280 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.132209 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.132215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.134187 (+ 1972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.134202 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.136392 (+ 2190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.136396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.136557 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.136612 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 06:54:21.136747 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 06:54:21.136936 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11500,"thread_start_us":16662,"threads_started":1}
I20260811 06:54:21.137360 10200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.114472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35414 (local address 127.12.145.3:44351)
0811 06:54:21.128530 (+ 14058us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.128541 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.128581 (+ 40us) server_negotiation.cc:407] Connection header received
0811 06:54:21.128696 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.128705 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.129265 (+ 560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.129478 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:21.130513 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.132060 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.134444 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.135960 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.136074 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.136282 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.136830 (+ 548us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.137006 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13838,"thread_start_us":14355,"threads_started":1}
I20260811 06:54:21.138438 10197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.114381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:46837 (local address 127.0.0.1:56882)
0811 06:54:21.129443 (+ 15062us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.129467 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:21.129591 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:21.131498 (+ 1907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:21.131502 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:21.131529 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:21.131957 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.131971 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.133701 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.133706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.135909 (+ 2203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.135934 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.137700 (+ 1766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.137706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.137865 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.137897 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 06:54:21.137973 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 06:54:21.138104 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14945,"thread_start_us":11175,"threads_started":1}
I20260811 06:54:21.139261 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.126492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:39519 (local address 127.0.0.1:40204)
0811 06:54:21.130580 (+ 4088us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.130602 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:21.130704 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:21.132100 (+ 1396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:21.132104 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:21.132130 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:21.132567 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.132580 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.134347 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.134352 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.136382 (+ 2030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.136399 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.138506 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.138512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.138668 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.138696 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 06:54:21.138776 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 06:54:21.138891 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3960,"mutex_wait_us":1,"thread_start_us":4269,"threads_started":1}
I20260811 06:54:21.139317 10203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.114612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56882 (local address 127.12.145.2:46837)
0811 06:54:21.129886 (+ 15274us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.129896 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.129928 (+ 32us) server_negotiation.cc:407] Connection header received
0811 06:54:21.130035 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.130043 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.130273 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.130492 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:21.132172 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.133558 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.136080 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.137386 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.137547 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.138811 (+ 1264us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.138883 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.139037 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15087,"thread_start_us":16074,"threads_started":1}
I20260811 06:54:21.139873 10206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.126880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40204 (local address 127.12.145.1:39519)
0811 06:54:21.131549 (+ 4669us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.131556 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.131581 (+ 25us) server_negotiation.cc:407] Connection header received
0811 06:54:21.131672 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.131679 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.131902 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.132093 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:21.132742 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.134183 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.136561 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.137987 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.138113 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.138343 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.139365 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.139547 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4495,"thread_start_us":4339,"threads_started":1}
I20260811 06:54:21.142494 9834 tablet_service.cc:1467] Processing CreateTablet for tablet 0170dc5aec2947aa99b5805bdb1030dc (DEFAULT_TABLE table=test-table [id=b118a32bb14348a8a74bce94ea3bf922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:21.142189 10057 tablet_service.cc:1467] Processing CreateTablet for tablet 0170dc5aec2947aa99b5805bdb1030dc (DEFAULT_TABLE table=test-table [id=b118a32bb14348a8a74bce94ea3bf922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:21.143273 9627 tablet_service.cc:1467] Processing CreateTablet for tablet 0170dc5aec2947aa99b5805bdb1030dc (DEFAULT_TABLE table=test-table [id=b118a32bb14348a8a74bce94ea3bf922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:21.143817 9834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0170dc5aec2947aa99b5805bdb1030dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:21.144107 10057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0170dc5aec2947aa99b5805bdb1030dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:21.144634 9627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0170dc5aec2947aa99b5805bdb1030dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:21.155380 10209 tablet_bootstrap.cc:492] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: Bootstrap starting.
I20260811 06:54:21.158650 10209 tablet_bootstrap.cc:654] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:21.158753 10210 tablet_bootstrap.cc:492] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723: Bootstrap starting.
I20260811 06:54:21.160104 10211 tablet_bootstrap.cc:492] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: Bootstrap starting.
I20260811 06:54:21.160418 10209 log.cc:824] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:21.163107 10211 tablet_bootstrap.cc:654] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:21.164040 10211 log.cc:824] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:21.164068 10210 tablet_bootstrap.cc:654] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:21.165253 10210 log.cc:824] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:21.166903 10209 tablet_bootstrap.cc:492] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: No bootstrap required, opened a new log
I20260811 06:54:21.166908 10211 tablet_bootstrap.cc:492] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: No bootstrap required, opened a new log
I20260811 06:54:21.167179 10211 ts_tablet_manager.cc:1397] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 06:54:21.167176 10209 ts_tablet_manager.cc:1397] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260811 06:54:21.167629 10210 tablet_bootstrap.cc:492] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723: No bootstrap required, opened a new log
I20260811 06:54:21.167862 10210 ts_tablet_manager.cc:1397] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 06:54:21.175139 10210 raft_consensus.cc:348] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97114e3a19054a159da88f538b9b53c5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44351 } } peers { permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 } } peers { permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 } }
I20260811 06:54:21.175467 10210 raft_consensus.cc:374] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:21.175601 10210 raft_consensus.cc:729] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3caca25aa4b4ad3b381663d642d1723, State: Initialized, Role: FOLLOWER
I20260811 06:54:21.176151 10210 consensus_queue.cc:260] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97114e3a19054a159da88f538b9b53c5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44351 } } peers { permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 } } peers { permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 } }
I20260811 06:54:21.177804 10210 ts_tablet_manager.cc:1428] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260811 06:54:21.177585 10209 raft_consensus.cc:348] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97114e3a19054a159da88f538b9b53c5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44351 } } peers { permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 } } peers { permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 } }
I20260811 06:54:21.177582 10211 raft_consensus.cc:348] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97114e3a19054a159da88f538b9b53c5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44351 } } peers { permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 } } peers { permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 } }
I20260811 06:54:21.178047 10209 raft_consensus.cc:374] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:21.178081 10211 raft_consensus.cc:374] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:21.178170 10211 raft_consensus.cc:729] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97114e3a19054a159da88f538b9b53c5, State: Initialized, Role: FOLLOWER
I20260811 06:54:21.178197 10209 raft_consensus.cc:729] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ad663aa80d45b29fa81cc8f1229f64, State: Initialized, Role: FOLLOWER
I20260811 06:54:21.178772 10211 consensus_queue.cc:260] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97114e3a19054a159da88f538b9b53c5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44351 } } peers { permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 } } peers { permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 } }
I20260811 06:54:21.178772 10209 consensus_queue.cc:260] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97114e3a19054a159da88f538b9b53c5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44351 } } peers { permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 } } peers { permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 } }
I20260811 06:54:21.185791 10179 heartbeater.cc:503] Master 127.12.145.62:42477 was elected leader, sending a full tablet report...
I20260811 06:54:21.186559 9949 heartbeater.cc:503] Master 127.12.145.62:42477 was elected leader, sending a full tablet report...
I20260811 06:54:21.186794 10211 ts_tablet_manager.cc:1428] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: Time spent starting tablet: real 0.020s user 0.011s sys 0.008s
I20260811 06:54:21.187155 10209 ts_tablet_manager.cc:1428] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: Time spent starting tablet: real 0.020s user 0.017s sys 0.004s
I20260811 06:54:21.245662 10217 raft_consensus.cc:482] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:21.245994 10217 raft_consensus.cc:504] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97114e3a19054a159da88f538b9b53c5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44351 } } peers { permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 } } peers { permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 } }
I20260811 06:54:21.247658 10217 leader_election.cc:288] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ad663aa80d45b29fa81cc8f1229f64 (127.12.145.2:46837), c3caca25aa4b4ad3b381663d642d1723 (127.12.145.1:39519)
I20260811 06:54:21.254415 10203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.248125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:52983 (local address 127.12.145.2:46837)
0811 06:54:21.248302 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.248308 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.248330 (+ 22us) server_negotiation.cc:407] Connection header received
0811 06:54:21.248721 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.248727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.248807 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.248886 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:21.249321 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.250246 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.252388 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.253480 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.253658 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.253731 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.254037 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.254161 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 06:54:21.254431 10184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.247938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:46837 (local address 127.12.145.3:52983)
0811 06:54:21.248137 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.248157 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:21.248282 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:21.248955 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:21.248960 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:21.248993 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:21.249190 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.249201 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.250375 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.250379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.252232 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.252248 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.253682 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.253688 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.253854 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.253888 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 06:54:21.253991 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 06:54:21.254127 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 06:54:21.254976 10206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.248563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:53293 (local address 127.12.145.1:39519)
0811 06:54:21.248745 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.248750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.249102 (+ 352us) server_negotiation.cc:407] Connection header received
0811 06:54:21.249243 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.249247 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.249322 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.249416 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:21.249903 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.250778 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.252897 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.254028 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.254162 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.254228 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.254623 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.254741 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 06:54:21.255622 10220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.248355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:39519 (local address 127.12.145.3:53293)
0811 06:54:21.248999 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.249016 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:21.249138 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:21.249439 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:21.249442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:21.249462 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:21.249769 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.249777 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.250930 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.250935 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.252739 (+ 1804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:21.252755 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.254230 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.254237 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:21.254422 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.254448 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 06:54:21.255179 (+ 731us) client_negotiation.cc:240] Negotiation successful
0811 06:54:21.255311 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":320,"threads_started":1}
I20260811 06:54:21.255666 9868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0170dc5aec2947aa99b5805bdb1030dc" candidate_uuid: "97114e3a19054a159da88f538b9b53c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" is_pre_election: true
I20260811 06:54:21.256268 9868 raft_consensus.cc:2454] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97114e3a19054a159da88f538b9b53c5 in term 0.
I20260811 06:54:21.256578 9655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0170dc5aec2947aa99b5805bdb1030dc" candidate_uuid: "97114e3a19054a159da88f538b9b53c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3caca25aa4b4ad3b381663d642d1723" is_pre_election: true
I20260811 06:54:21.256949 9980 leader_election.cc:302] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97114e3a19054a159da88f538b9b53c5, d5ad663aa80d45b29fa81cc8f1229f64; no voters:
I20260811 06:54:21.257123 9655 raft_consensus.cc:2454] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97114e3a19054a159da88f538b9b53c5 in term 0.
I20260811 06:54:21.257366 10217 raft_consensus.cc:2781] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:54:21.257530 10217 raft_consensus.cc:482] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:54:21.257642 10217 raft_consensus.cc:3037] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:21.259837 10217 raft_consensus.cc:504] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97114e3a19054a159da88f538b9b53c5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44351 } } peers { permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 } } peers { permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 } }
I20260811 06:54:21.260375 10217 leader_election.cc:288] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [CANDIDATE]: Term 1 election: Requested vote from peers d5ad663aa80d45b29fa81cc8f1229f64 (127.12.145.2:46837), c3caca25aa4b4ad3b381663d642d1723 (127.12.145.1:39519)
I20260811 06:54:21.260764 9868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0170dc5aec2947aa99b5805bdb1030dc" candidate_uuid: "97114e3a19054a159da88f538b9b53c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ad663aa80d45b29fa81cc8f1229f64"
I20260811 06:54:21.260800 9655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0170dc5aec2947aa99b5805bdb1030dc" candidate_uuid: "97114e3a19054a159da88f538b9b53c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3caca25aa4b4ad3b381663d642d1723"
I20260811 06:54:21.260934 9868 raft_consensus.cc:3037] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:21.260962 9655 raft_consensus.cc:3037] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:54:21.262141 9732 tablet.cc:2369] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:54:21.263398 9655 raft_consensus.cc:2454] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97114e3a19054a159da88f538b9b53c5 in term 1.
I20260811 06:54:21.263607 9868 raft_consensus.cc:2454] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97114e3a19054a159da88f538b9b53c5 in term 1.
I20260811 06:54:21.263748 9980 leader_election.cc:302] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97114e3a19054a159da88f538b9b53c5, c3caca25aa4b4ad3b381663d642d1723; no voters:
I20260811 06:54:21.264014 10217 raft_consensus.cc:2781] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:21.264444 10217 raft_consensus.cc:686] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 1 LEADER]: Becoming Leader. State: Replica: 97114e3a19054a159da88f538b9b53c5, State: Running, Role: LEADER
I20260811 06:54:21.264882 10217 consensus_queue.cc:237] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97114e3a19054a159da88f538b9b53c5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44351 } } peers { permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 } } peers { permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 } }
I20260811 06:54:21.270109 9438 catalog_manager.cc:5495] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97114e3a19054a159da88f538b9b53c5 (127.12.145.3). New cstate: current_term: 1 leader_uuid: "97114e3a19054a159da88f538b9b53c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97114e3a19054a159da88f538b9b53c5" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 } health_report { overall_health: UNKNOWN } } }
W20260811 06:54:21.276540 9951 tablet.cc:2369] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:54:21.295024 10200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.289865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35428 (local address 127.12.145.3:44351)
0811 06:54:21.290083 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.290090 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.290203 (+ 113us) server_negotiation.cc:407] Connection header received
0811 06:54:21.290371 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.290375 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.290454 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.290603 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:54:21.290889 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.291646 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.292998 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.293444 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.293599 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.294010 (+ 411us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:54:21.294501 (+ 491us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:54:21.294611 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.294684 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.294749 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 06:54:21.296864 10182 tablet.cc:2369] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:54:21.303053 9868 raft_consensus.cc:1261] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64 [term 1 FOLLOWER]: Refusing update from remote peer 97114e3a19054a159da88f538b9b53c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:21.303066 9655 raft_consensus.cc:1261] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723 [term 1 FOLLOWER]: Refusing update from remote peer 97114e3a19054a159da88f538b9b53c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:21.304009 10222 consensus_queue.cc:1035] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ad663aa80d45b29fa81cc8f1229f64" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 46837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:21.304338 10217 consensus_queue.cc:1035] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3caca25aa4b4ad3b381663d642d1723" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:21.328783 9438 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55494:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:21.329041 9438 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55494:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:21.332602 9438 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0185106fbca94c49ada1e1046ca06261: Sending DeleteTablet for 3 replicas of tablet 0170dc5aec2947aa99b5805bdb1030dc
I20260811 06:54:21.333689 10057 tablet_service.cc:1514] Processing DeleteTablet for tablet 0170dc5aec2947aa99b5805bdb1030dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:21 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:35414
I20260811 06:54:21.333819 9834 tablet_service.cc:1514] Processing DeleteTablet for tablet 0170dc5aec2947aa99b5805bdb1030dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:21 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:56882
I20260811 06:54:21.334081 9627 tablet_service.cc:1514] Processing DeleteTablet for tablet 0170dc5aec2947aa99b5805bdb1030dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:21 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:40204
I20260811 06:54:21.334976 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 9540
I20260811 06:54:21.342684 10245 tablet_replica.cc:330] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: stopping tablet replica
I20260811 06:54:21.343181 10245 raft_consensus.cc:2229] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:21.343757 10245 raft_consensus.cc:2258] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:21.346009 10244 tablet_replica.cc:330] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: stopping tablet replica
I20260811 06:54:21.346450 10244 raft_consensus.cc:2229] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:54:21.346565 10245 ts_tablet_manager.cc:1905] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:21.349490 10244 raft_consensus.cc:2258] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 11 06:54:21 dist-test-slave-7lbf krb5kdc[9373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:54:21.353951 10246 tablet_replica.cc:330] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723: stopping tablet replica
I20260811 06:54:21.355180 10245 ts_tablet_manager.cc:1918] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:21.355420 10245 log.cc:1196] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/0170dc5aec2947aa99b5805bdb1030dc
I20260811 06:54:21.355778 10246 raft_consensus.cc:2229] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:21.356096 10245 ts_tablet_manager.cc:1939] T 0170dc5aec2947aa99b5805bdb1030dc P d5ad663aa80d45b29fa81cc8f1229f64: Deleting consensus metadata
I20260811 06:54:21.356164 10244 ts_tablet_manager.cc:1905] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:21.356776 10246 raft_consensus.cc:2258] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:21.358201 9416 catalog_manager.cc:4841] TS d5ad663aa80d45b29fa81cc8f1229f64 (127.12.145.2:46837): tablet 0170dc5aec2947aa99b5805bdb1030dc (table test-table [id=b118a32bb14348a8a74bce94ea3bf922]) successfully deleted
I20260811 06:54:21.362620 10246 ts_tablet_manager.cc:1905] T 0170dc5aec2947aa99b5805bdb1030dc P c3caca25aa4b4ad3b381663d642d1723: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:21.363813 10206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.336105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40218 (local address 127.12.145.1:39519)
0811 06:54:21.336269 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.336275 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.342038 (+ 5763us) server_negotiation.cc:407] Connection header received
0811 06:54:21.342217 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.342223 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.342308 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.342403 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:21.344154 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.345321 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.347266 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.347959 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.348076 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.355185 (+ 7109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:21.355225 (+ 40us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:21.355243 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:21.355292 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:21.359299 (+ 4007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:21.360205 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:21.360215 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:21.360218 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:21.360437 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:21.360998 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:21.361003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:21.361007 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:21.361579 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:21.361884 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.363137 (+ 1253us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.363377 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 06:54:21.364720 9726 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:21.365051 10244 ts_tablet_manager.cc:1918] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:21.365312 10244 log.cc:1196] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/0170dc5aec2947aa99b5805bdb1030dc
I20260811 06:54:21.365967 10244 ts_tablet_manager.cc:1939] T 0170dc5aec2947aa99b5805bdb1030dc P 97114e3a19054a159da88f538b9b53c5: Deleting consensus metadata
I20260811 06:54:21.367763 9413 catalog_manager.cc:4841] TS 97114e3a19054a159da88f538b9b53c5 (127.12.145.3:44351): tablet 0170dc5aec2947aa99b5805bdb1030dc (table test-table [id=b118a32bb14348a8a74bce94ea3bf922]) successfully deleted
I20260811 06:54:21.467758 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 9540
W20260811 06:54:21.492497 9416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.1:39519 (error 108)
I20260811 06:54:21.493292 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 9742
I20260811 06:54:21.494820 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.494281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:39519 (local address 127.0.0.1:40222)
0811 06:54:21.494523 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.494646 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:39519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
W20260811 06:54:21.495216 9416 catalog_manager.cc:4584] TS c3caca25aa4b4ad3b381663d642d1723 (127.12.145.1:39519): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0170dc5aec2947aa99b5805bdb1030dc: Network error: Client connection negotiation failed: client connection to 127.12.145.1:39519: connect: Connection refused (error 111)
Aug 11 06:54:21 dist-test-slave-7lbf krb5kdc[9373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:54:21.509545 10203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.494187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56888 (local address 127.12.145.2:46837)
0811 06:54:21.494372 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.494378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.494496 (+ 118us) server_negotiation.cc:407] Connection header received
0811 06:54:21.494699 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.494707 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.494803 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.494898 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:21.496425 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.497335 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.498815 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.499239 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.499367 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.503682 (+ 4315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:21.503698 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:21.503713 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:21.503749 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:21.506619 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:21.507350 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:21.507358 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:21.507361 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:21.507501 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:21.507895 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:21.507900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:21.507902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:21.508308 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:21.508609 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.508960 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.509175 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:54:21.510377 9943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:21.549052 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.548444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:39519 (local address 127.0.0.1:40234)
0811 06:54:21.548718 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.548846 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:39519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 06:54:21.550315 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.549881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:39519 (local address 127.0.0.1:40244)
0811 06:54:21.550045 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.550163 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:39519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 06:54:21.608994 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 9742
I20260811 06:54:21.611380 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.610616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:39519 (local address 127.0.0.1:40248)
0811 06:54:21.611024 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.611153 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:39519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259}
I20260811 06:54:21.613824 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.613265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:39519 (local address 127.0.0.1:40254)
0811 06:54:21.613538 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.613640 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:39519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260811 06:54:21.632189 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 9956
Aug 11 06:54:21 dist-test-slave-7lbf krb5kdc[9373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:54:21.651417 10200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.633018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35436 (local address 127.12.145.3:44351)
0811 06:54:21.633203 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:21.633208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:21.633229 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:54:21.633447 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:21.633451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:21.633609 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:21.633715 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:21.635631 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.636509 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.638474 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:21.638990 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:21.639120 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:21.644437 (+ 5317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:21.644459 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:21.644486 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:21.644541 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:21.648435 (+ 3894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:21.649121 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:21.649131 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:21.649134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:21.649335 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:21.649727 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:21.649733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:21.649736 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:21.650227 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:21.650525 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:21.650740 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 06:54:21.650986 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 06:54:21.652220 10172 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:21.695254 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.694696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:39519 (local address 127.0.0.1:40268)
0811 06:54:21.694978 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.695097 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:39519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260811 06:54:21.696323 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.695959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:39519 (local address 127.0.0.1:40270)
0811 06:54:21.696147 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.696217 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:39519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260811 06:54:21.774968 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 9956
I20260811 06:54:21.802464 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 9391
I20260811 06:54:21.803668 9484 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:21.913964 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:21.913343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:39519 (local address 127.0.0.1:40282)
0811 06:54:21.913646 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:21.913761 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:39519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 06:54:21.914021 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 9391
2026-08-11T06:54:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4515 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T06:54:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:21Z Disabled control of system clock
I20260811 06:54:22.005662 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:45441
--webserver_interface=127.12.145.62
--webserver_port=0
--builtin_ntp_servers=127.12.145.20:43957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:45441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 06:54:22.335227 10266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:22.335503 10266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:22.335592 10266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:22.342667 10266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:22.342768 10266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:22.342826 10266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:22.342883 10266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:22.342926 10266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:22.351837 10266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:45441
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:45441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:22.353024 10266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:22.354741 10266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:22.365731 10275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:22.365779 10284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:22.365808 10279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:22.367053 10266 server_base.cc:1034] running on GCE node
I20260811 06:54:22.367779 10266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:22.369192 10266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:22.370389 10266 hybrid_clock.cc:648] HybridClock initialized: now 1786431262370326 us; error 58 us; skew 500 ppm
I20260811 06:54:22.370743 10266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:22.376572 10266 webserver.cc:460] Webserver started at http://127.12.145.62:37049/ using document root <none> and password file <none>
I20260811 06:54:22.377287 10266 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:22.377395 10266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:22.377763 10266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:22.380839 10266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "77df5b33dc9242c59ec4f0c0af256113"
format_stamp: "Formatted at 2026-08-11 06:54:22 on dist-test-slave-7lbf"
server_key: "6b097fa6638046a7a067a5535925efc3"
server_key_iv: "85968ecbddd4bcf5877ba5b2e6b9931b"
server_key_version: "encryptionkey@0"
I20260811 06:54:22.381824 10266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "77df5b33dc9242c59ec4f0c0af256113"
format_stamp: "Formatted at 2026-08-11 06:54:22 on dist-test-slave-7lbf"
server_key: "6b097fa6638046a7a067a5535925efc3"
server_key_iv: "85968ecbddd4bcf5877ba5b2e6b9931b"
server_key_version: "encryptionkey@0"
I20260811 06:54:22.387197 10266 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 06:54:22.390725 10300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:22.392023 10266 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:54:22.392190 10266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "77df5b33dc9242c59ec4f0c0af256113"
format_stamp: "Formatted at 2026-08-11 06:54:22 on dist-test-slave-7lbf"
server_key: "6b097fa6638046a7a067a5535925efc3"
server_key_iv: "85968ecbddd4bcf5877ba5b2e6b9931b"
server_key_version: "encryptionkey@0"
I20260811 06:54:22.392386 10266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:22.411789 10266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:22.412612 10266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:22.412895 10266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:22.430377 10266 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:45441
I20260811 06:54:22.430398 10380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:45441 every 8 connection(s)
I20260811 06:54:22.431710 10266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:22.435428 10381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:22.440068 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 10266
I20260811 06:54:22.440230 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:22.440677 12868 external_mini_cluster.cc:1428] Setting key 4123558c49aa6c8d8a4d8f79730fc5e9
I20260811 06:54:22.446278 10381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113: Bootstrap starting.
I20260811 06:54:22.449958 10381 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:22.451156 10381 log.cc:824] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:22.454238 10381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113: No bootstrap required, opened a new log
I20260811 06:54:22.454644 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:22.442482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38248 (local address 127.12.145.62:45441)
0811 06:54:22.443548 (+ 1066us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:22.443558 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:22.443602 (+ 44us) server_negotiation.cc:407] Connection header received
0811 06:54:22.445362 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:22.445386 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:22.445910 (+ 524us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:22.446228 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:22.446918 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:22.448204 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:22.450216 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:22.450944 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:22.451077 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:22.452381 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:22.452392 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:22.452410 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:22.452951 (+ 541us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:22.453026 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:22.453048 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:22.453129 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:22.453364 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 06:54:22.453664 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":430,"threads_started":1}
I20260811 06:54:22.461666 10381 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77df5b33dc9242c59ec4f0c0af256113" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45441 } }
I20260811 06:54:22.462037 10381 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:22.462136 10381 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77df5b33dc9242c59ec4f0c0af256113, State: Initialized, Role: FOLLOWER
I20260811 06:54:22.462695 10381 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77df5b33dc9242c59ec4f0c0af256113" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45441 } }
I20260811 06:54:22.463001 10381 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:22.463151 10381 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:22.463330 10381 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:22.465628 10381 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77df5b33dc9242c59ec4f0c0af256113" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45441 } }
I20260811 06:54:22.466138 10381 leader_election.cc:302] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77df5b33dc9242c59ec4f0c0af256113; no voters:
I20260811 06:54:22.466696 10381 leader_election.cc:288] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:22.466825 10387 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:22.467530 10387 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [term 1 LEADER]: Becoming Leader. State: Replica: 77df5b33dc9242c59ec4f0c0af256113, State: Running, Role: LEADER
I20260811 06:54:22.468007 10387 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77df5b33dc9242c59ec4f0c0af256113" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45441 } }
I20260811 06:54:22.468693 10381 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:22.470654 10395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77df5b33dc9242c59ec4f0c0af256113. Latest consensus state: current_term: 1 leader_uuid: "77df5b33dc9242c59ec4f0c0af256113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77df5b33dc9242c59ec4f0c0af256113" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45441 } } }
I20260811 06:54:22.471047 10395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:22.471635 10392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77df5b33dc9242c59ec4f0c0af256113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77df5b33dc9242c59ec4f0c0af256113" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45441 } } }
I20260811 06:54:22.471949 10392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:22.473001 10398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:22.478212 10398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:22.491796 10398 catalog_manager.cc:1347] Generated new cluster ID: c06770d447424572a03414a0198e8419
I20260811 06:54:22.491951 10398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:22.510380 10398 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:22.511952 10398 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:22.528439 10398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113: Generated new TSK 0
I20260811 06:54:22.529354 10398 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:22.539657 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45441
--builtin_ntp_servers=127.12.145.20:43957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 06:54:22.900472 10419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:22.900731 10419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:22.900825 10419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:22.907811 10419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:22.907905 10419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:22.908021 10419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:54:22.916952 10419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:22.918196 10419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:22.919991 10419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:22.932770 10427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:22.932723 10428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:22.932811 10432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:22.933604 10419 server_base.cc:1034] running on GCE node
I20260811 06:54:22.934155 10419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:22.935036 10419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:22.936237 10419 hybrid_clock.cc:648] HybridClock initialized: now 1786431262936191 us; error 35 us; skew 500 ppm
I20260811 06:54:22.936527 10419 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:22.938743 10419 webserver.cc:460] Webserver started at http://127.12.145.1:36591/ using document root <none> and password file <none>
I20260811 06:54:22.939435 10419 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:22.939543 10419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:22.939852 10419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:22.942677 10419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "8043beff984647d59a488ab059163453"
format_stamp: "Formatted at 2026-08-11 06:54:22 on dist-test-slave-7lbf"
server_key: "0bee540381a1b3c5ef60b3b7e3899b5a"
server_key_iv: "7e916e059d9e7a99e7451c39be0d4de9"
server_key_version: "encryptionkey@0"
I20260811 06:54:22.943455 10419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "8043beff984647d59a488ab059163453"
format_stamp: "Formatted at 2026-08-11 06:54:22 on dist-test-slave-7lbf"
server_key: "0bee540381a1b3c5ef60b3b7e3899b5a"
server_key_iv: "7e916e059d9e7a99e7451c39be0d4de9"
server_key_version: "encryptionkey@0"
I20260811 06:54:22.948284 10419 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:54:22.951634 10443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:22.952875 10419 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:54:22.953023 10419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "8043beff984647d59a488ab059163453"
format_stamp: "Formatted at 2026-08-11 06:54:22 on dist-test-slave-7lbf"
server_key: "0bee540381a1b3c5ef60b3b7e3899b5a"
server_key_iv: "7e916e059d9e7a99e7451c39be0d4de9"
server_key_version: "encryptionkey@0"
I20260811 06:54:22.953207 10419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:22.975208 10419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:22.976029 10419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:22.976321 10419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:22.977273 10419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:22.978822 10419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:22.978917 10419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:22.979024 10419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:22.979094 10419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:23.010385 10419 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:35601
I20260811 06:54:23.010469 10622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:35601 every 8 connection(s)
I20260811 06:54:23.011656 10419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:54:23.014590 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 10419
I20260811 06:54:23.014755 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:54:23.015195 12868 external_mini_cluster.cc:1428] Setting key 21c47e29ab8b99efc54a999dc9a3b170
I20260811 06:54:23.018039 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45441
--builtin_ntp_servers=127.12.145.20:43957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 06:54:23.024333 10627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.014166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:46447 (local address 127.12.145.62:45441)
0811 06:54:23.014674 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:23.014680 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:23.015965 (+ 1285us) server_negotiation.cc:407] Connection header received
0811 06:54:23.017956 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:23.017961 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:23.018047 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:23.018161 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:23.019212 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.020206 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.021724 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.022239 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.022370 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.023566 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:23.023572 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:23.023576 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:23.023596 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:23.023645 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:23.023660 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:23.023735 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:23.023911 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 06:54:23.024002 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":244,"threads_started":1}
I20260811 06:54:23.025137 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.014754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:45441 (local address 127.12.145.1:46447)
0811 06:54:23.015811 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:23.015856 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:23.017706 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:23.018401 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:23.018409 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:23.018510 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:23.019050 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.019066 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.020322 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.020325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.021580 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.021593 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.022426 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.022430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.022648 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.023276 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:54:23.023279 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:23.023316 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:54:23.023393 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:23.023744 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:23.023750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:23.023755 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 06:54:23.023880 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 06:54:23.024148 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":325,"threads_started":1}
I20260811 06:54:23.026561 10623 heartbeater.cc:347] Connected to a master server at 127.12.145.62:45441
I20260811 06:54:23.026862 10623 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:23.027702 10623 heartbeater.cc:511] Master 127.12.145.62:45441 requested a full tablet report, sending...
I20260811 06:54:23.029769 10328 ts_manager.cc:194] Registered new tserver with Master: 8043beff984647d59a488ab059163453 (127.12.145.1:35601)
I20260811 06:54:23.031641 10328 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.1:46447
W20260811 06:54:23.350883 10632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:23.351171 10632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:23.351300 10632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:23.358577 10632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:23.358701 10632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:23.358825 10632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:54:23.367980 10632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:23.369300 10632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:23.371142 10632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:23.383893 10639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:23.383854 10645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:23.383816 10640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:23.384718 10632 server_base.cc:1034] running on GCE node
I20260811 06:54:23.385296 10632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:23.386284 10632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:23.387506 10632 hybrid_clock.cc:648] HybridClock initialized: now 1786431263387450 us; error 46 us; skew 500 ppm
I20260811 06:54:23.387806 10632 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:23.390076 10632 webserver.cc:460] Webserver started at http://127.12.145.2:42271/ using document root <none> and password file <none>
I20260811 06:54:23.390786 10632 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:23.390882 10632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:23.391185 10632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:23.393978 10632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "3110209846374ef7abcdada3e7aa630f"
format_stamp: "Formatted at 2026-08-11 06:54:23 on dist-test-slave-7lbf"
server_key: "8b59351848f9d5ff3061b74d4528549c"
server_key_iv: "ba0efc5bd7ca116a5e68162eaaa41863"
server_key_version: "encryptionkey@0"
I20260811 06:54:23.394757 10632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "3110209846374ef7abcdada3e7aa630f"
format_stamp: "Formatted at 2026-08-11 06:54:23 on dist-test-slave-7lbf"
server_key: "8b59351848f9d5ff3061b74d4528549c"
server_key_iv: "ba0efc5bd7ca116a5e68162eaaa41863"
server_key_version: "encryptionkey@0"
I20260811 06:54:23.399766 10632 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:54:23.403256 10653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:23.404523 10632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:54:23.404675 10632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "3110209846374ef7abcdada3e7aa630f"
format_stamp: "Formatted at 2026-08-11 06:54:23 on dist-test-slave-7lbf"
server_key: "8b59351848f9d5ff3061b74d4528549c"
server_key_iv: "ba0efc5bd7ca116a5e68162eaaa41863"
server_key_version: "encryptionkey@0"
I20260811 06:54:23.404863 10632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:23.427357 10632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:23.428189 10632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:23.428493 10632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:23.429458 10632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:23.431010 10632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:23.431105 10632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:23.431211 10632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:23.431282 10632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:23.464212 10632 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:35925
I20260811 06:54:23.464275 10842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:35925 every 8 connection(s)
I20260811 06:54:23.465535 10632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:54:23.470796 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 10632
I20260811 06:54:23.470953 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:54:23.471402 12868 external_mini_cluster.cc:1428] Setting key a1731f3262d3ffd51a4b9d676f027eb6
I20260811 06:54:23.474303 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45441
--builtin_ntp_servers=127.12.145.20:43957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 06:54:23.478368 10627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.468074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:40873 (local address 127.12.145.62:45441)
0811 06:54:23.468261 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:23.468265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:23.469716 (+ 1451us) server_negotiation.cc:407] Connection header received
0811 06:54:23.471584 (+ 1868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:23.471591 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:23.471680 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:23.471773 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:23.472925 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.473891 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.475614 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.476178 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.476298 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.477598 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:23.477604 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:23.477608 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:23.477629 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:23.477665 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:23.477679 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:23.477759 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:23.477954 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 06:54:23.478048 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 06:54:23.479346 10845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.468585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:45441 (local address 127.12.145.2:40873)
0811 06:54:23.469558 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:23.469608 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:23.471322 (+ 1714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:23.472007 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:23.472015 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:23.472133 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:23.472766 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.472783 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.474063 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.474067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.475470 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.475484 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.476384 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.476389 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.476599 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.477269 (+ 670us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:54:23.477272 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:23.477312 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:54:23.477397 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:23.477764 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:23.477772 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:23.477778 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 06:54:23.477922 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 06:54:23.478246 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":272,"threads_started":1}
I20260811 06:54:23.480717 10843 heartbeater.cc:347] Connected to a master server at 127.12.145.62:45441
I20260811 06:54:23.481007 10843 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:23.481773 10843 heartbeater.cc:511] Master 127.12.145.62:45441 requested a full tablet report, sending...
I20260811 06:54:23.483204 10328 ts_manager.cc:194] Registered new tserver with Master: 3110209846374ef7abcdada3e7aa630f (127.12.145.2:35925)
I20260811 06:54:23.484194 10328 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.2:40873
W20260811 06:54:23.803054 10850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:23.803345 10850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:23.803491 10850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:23.810837 10850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:23.810942 10850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:23.811082 10850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:54:23.819954 10850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:43957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:45441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:23.821210 10850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:23.822979 10850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:23.835397 10860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:23.835453 10861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:23.835481 10863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:23.836138 10850 server_base.cc:1034] running on GCE node
I20260811 06:54:23.836735 10850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:23.837649 10850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:23.838837 10850 hybrid_clock.cc:648] HybridClock initialized: now 1786431263838786 us; error 46 us; skew 500 ppm
I20260811 06:54:23.839125 10850 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:23.841189 10850 webserver.cc:460] Webserver started at http://127.12.145.3:38965/ using document root <none> and password file <none>
I20260811 06:54:23.841881 10850 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:23.841975 10850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:23.842278 10850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:23.844998 10850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "f64614a70ad94a059590cb1e6b47dd75"
format_stamp: "Formatted at 2026-08-11 06:54:23 on dist-test-slave-7lbf"
server_key: "572c087fd5e9db89f55b240ee7ba2ffb"
server_key_iv: "d0be423a4790e8a719615169b1f8fcb5"
server_key_version: "encryptionkey@0"
I20260811 06:54:23.845810 10850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "f64614a70ad94a059590cb1e6b47dd75"
format_stamp: "Formatted at 2026-08-11 06:54:23 on dist-test-slave-7lbf"
server_key: "572c087fd5e9db89f55b240ee7ba2ffb"
server_key_iv: "d0be423a4790e8a719615169b1f8fcb5"
server_key_version: "encryptionkey@0"
I20260811 06:54:23.850626 10850 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 06:54:23.853920 10876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:23.855154 10850 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 06:54:23.855301 10850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "f64614a70ad94a059590cb1e6b47dd75"
format_stamp: "Formatted at 2026-08-11 06:54:23 on dist-test-slave-7lbf"
server_key: "572c087fd5e9db89f55b240ee7ba2ffb"
server_key_iv: "d0be423a4790e8a719615169b1f8fcb5"
server_key_version: "encryptionkey@0"
I20260811 06:54:23.855496 10850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:23.872614 10850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:23.873401 10850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:23.873732 10850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:23.874715 10850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:23.876207 10850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:23.876308 10850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:23.876417 10850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:23.876504 10850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:23.907405 10850 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:41033
I20260811 06:54:23.907451 11066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:41033 every 8 connection(s)
I20260811 06:54:23.908757 10850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:54:23.913638 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 10850
I20260811 06:54:23.913798 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:54:23.914227 12868 external_mini_cluster.cc:1428] Setting key 7d062255ffc3f1a3df710e24cd9005d1
I20260811 06:54:23.921583 10627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.911276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:52599 (local address 127.12.145.62:45441)
0811 06:54:23.911438 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:23.911443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:23.912795 (+ 1352us) server_negotiation.cc:407] Connection header received
0811 06:54:23.914719 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:23.914725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:23.914813 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:23.914925 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:23.916160 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.916979 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.918963 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.919361 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.919473 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.920750 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:23.920755 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:23.920758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:23.920775 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:23.920809 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:23.920820 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:23.920894 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:23.921103 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 06:54:23.921199 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 06:54:23.922526 11074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.911720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:45441 (local address 127.12.145.3:52599)
0811 06:54:23.912638 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:23.912675 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:23.914445 (+ 1770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:23.915155 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:23.915167 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:23.915281 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:23.916009 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.916031 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.917122 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.917125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.918823 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.918836 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.919574 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.919582 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.919812 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.920444 (+ 632us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:54:23.920446 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:23.920490 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:54:23.920565 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:23.920911 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:23.920922 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:23.920929 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 06:54:23.921082 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 06:54:23.921465 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":259,"threads_started":1}
I20260811 06:54:23.923864 11067 heartbeater.cc:347] Connected to a master server at 127.12.145.62:45441
I20260811 06:54:23.924113 11067 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:23.924813 11067 heartbeater.cc:511] Master 127.12.145.62:45441 requested a full tablet report, sending...
I20260811 06:54:23.926156 10328 ts_manager.cc:194] Registered new tserver with Master: f64614a70ad94a059590cb1e6b47dd75 (127.12.145.3:41033)
I20260811 06:54:23.926921 10328 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.3:52599
I20260811 06:54:23.929260 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:54:23.938854 10627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.933195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38262 (local address 127.12.145.62:45441)
0811 06:54:23.933349 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:23.933355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:23.933783 (+ 428us) server_negotiation.cc:407] Connection header received
0811 06:54:23.933953 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:23.933958 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:23.934032 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:23.934111 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:23.934583 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.935283 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.936647 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.937064 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.937171 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.938209 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:23.938215 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:23.938219 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:23.938235 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:23.938267 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:23.938278 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:23.938358 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:23.938492 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 06:54:23.938580 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 06:54:23.942363 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:54:23.948979 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:54:23.971388 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.960600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:35925 (local address 127.0.0.1:39252)
0811 06:54:23.961339 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:23.961387 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:23.961580 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:23.962768 (+ 1188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:23.962777 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:23.962815 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:23.963146 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.963157 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.965174 (+ 2017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.965178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.967642 (+ 2464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.967657 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.970226 (+ 2569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.970235 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.970521 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.970600 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 06:54:23.970748 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 06:54:23.970961 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":25,"thread_start_us":326,"threads_started":1}
I20260811 06:54:23.972687 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.960935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39252 (local address 127.12.145.2:35925)
0811 06:54:23.961481 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:23.961488 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:23.961541 (+ 53us) server_negotiation.cc:407] Connection header received
0811 06:54:23.961917 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:23.961927 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:23.962175 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:23.962389 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:23.963341 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.965018 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.967941 (+ 2923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.969610 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.969745 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.970085 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:23.972074 (+ 1989us) server_negotiation.cc:299] Negotiation successful
0811 06:54:23.972265 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":258,"threads_started":1}
I20260811 06:54:23.974748 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.961788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35601 (local address 127.0.0.1:52922)
0811 06:54:23.965994 (+ 4206us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:23.966028 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:23.966266 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:23.967231 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:23.967236 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:23.967263 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:23.967738 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.967748 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.969723 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.969728 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.971948 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.971961 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.973977 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.973981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.974133 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.974156 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 06:54:23.974242 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 06:54:23.974377 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4062,"mutex_wait_us":43,"thread_start_us":3910,"threads_started":1}
I20260811 06:54:23.974839 11101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.962099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52922 (local address 127.12.145.1:35601)
0811 06:54:23.962674 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:23.962683 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:23.966146 (+ 3463us) server_negotiation.cc:407] Connection header received
0811 06:54:23.966516 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:23.966526 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:23.966759 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:23.966937 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:23.967944 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.969457 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.972175 (+ 2718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.973442 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.973575 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.973784 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:23.974312 (+ 528us) server_negotiation.cc:299] Negotiation successful
0811 06:54:23.974475 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":278,"threads_started":1}
I20260811 06:54:23.980492 10524 tablet_service.cc:1467] Processing CreateTablet for tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4 (DEFAULT_TABLE table=test-table [id=b080fa8bc30741b6900533dac49bb4b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:23.980509 10739 tablet_service.cc:1467] Processing CreateTablet for tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4 (DEFAULT_TABLE table=test-table [id=b080fa8bc30741b6900533dac49bb4b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:23.982146 10524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:23.982347 10739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:23.982362 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.966012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:41033 (local address 127.0.0.1:41376)
0811 06:54:23.971747 (+ 5735us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:23.971766 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:23.971885 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:23.975873 (+ 3988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:23.975878 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:23.975903 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:23.976094 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.976107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.977995 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.978000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.979752 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:23.979767 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.981642 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.981648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:23.981832 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.981864 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 06:54:23.981946 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 06:54:23.982094 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5634,"thread_start_us":10240,"threads_started":1}
I20260811 06:54:23.982666 11104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:23.966296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41376 (local address 127.12.145.3:41033)
0811 06:54:23.975403 (+ 9107us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:23.975410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:23.975441 (+ 31us) server_negotiation.cc:407] Connection header received
0811 06:54:23.975526 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:23.975531 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:23.975688 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:23.975877 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:23.976292 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.977791 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.979946 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:23.981446 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:23.981614 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:23.981909 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:23.981997 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 06:54:23.982160 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8951,"thread_start_us":8786,"threads_started":1}
I20260811 06:54:23.986891 10960 tablet_service.cc:1467] Processing CreateTablet for tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4 (DEFAULT_TABLE table=test-table [id=b080fa8bc30741b6900533dac49bb4b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:23.988360 10960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:23.994623 11106 tablet_bootstrap.cc:492] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: Bootstrap starting.
I20260811 06:54:23.997138 11107 tablet_bootstrap.cc:492] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453: Bootstrap starting.
I20260811 06:54:23.998204 11106 tablet_bootstrap.cc:654] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:23.999693 11106 log.cc:824] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:24.000607 11107 tablet_bootstrap.cc:654] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:24.001747 11107 log.cc:824] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:24.002775 11118 tablet_bootstrap.cc:492] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: Bootstrap starting.
I20260811 06:54:24.003787 11106 tablet_bootstrap.cc:492] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: No bootstrap required, opened a new log
I20260811 06:54:24.004098 11106 ts_tablet_manager.cc:1397] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 06:54:24.005698 11118 tablet_bootstrap.cc:654] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:24.006999 11118 log.cc:824] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:24.008375 11107 tablet_bootstrap.cc:492] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453: No bootstrap required, opened a new log
I20260811 06:54:24.008673 11107 ts_tablet_manager.cc:1397] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260811 06:54:24.010214 11118 tablet_bootstrap.cc:492] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: No bootstrap required, opened a new log
I20260811 06:54:24.010488 11118 ts_tablet_manager.cc:1397] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 06:54:24.013044 11106 raft_consensus.cc:348] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3110209846374ef7abcdada3e7aa630f" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35925 } } peers { permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 } } peers { permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 } }
I20260811 06:54:24.013386 11106 raft_consensus.cc:374] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:24.013478 11106 raft_consensus.cc:729] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3110209846374ef7abcdada3e7aa630f, State: Initialized, Role: FOLLOWER
I20260811 06:54:24.014118 11106 consensus_queue.cc:260] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3110209846374ef7abcdada3e7aa630f" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35925 } } peers { permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 } } peers { permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 } }
I20260811 06:54:24.020783 11118 raft_consensus.cc:348] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3110209846374ef7abcdada3e7aa630f" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35925 } } peers { permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 } } peers { permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 } }
I20260811 06:54:24.020799 11107 raft_consensus.cc:348] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3110209846374ef7abcdada3e7aa630f" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35925 } } peers { permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 } } peers { permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 } }
I20260811 06:54:24.021248 11118 raft_consensus.cc:374] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:24.021330 11107 raft_consensus.cc:374] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:24.021373 11118 raft_consensus.cc:729] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f64614a70ad94a059590cb1e6b47dd75, State: Initialized, Role: FOLLOWER
I20260811 06:54:24.021552 11107 raft_consensus.cc:729] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8043beff984647d59a488ab059163453, State: Initialized, Role: FOLLOWER
I20260811 06:54:24.022151 11118 consensus_queue.cc:260] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3110209846374ef7abcdada3e7aa630f" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35925 } } peers { permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 } } peers { permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 } }
I20260811 06:54:24.022163 11107 consensus_queue.cc:260] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3110209846374ef7abcdada3e7aa630f" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35925 } } peers { permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 } } peers { permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 } }
I20260811 06:54:24.031397 11118 ts_tablet_manager.cc:1428] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: Time spent starting tablet: real 0.021s user 0.015s sys 0.004s
I20260811 06:54:24.032217 10843 heartbeater.cc:503] Master 127.12.145.62:45441 was elected leader, sending a full tablet report...
I20260811 06:54:24.032277 11067 heartbeater.cc:503] Master 127.12.145.62:45441 was elected leader, sending a full tablet report...
I20260811 06:54:24.032989 11107 ts_tablet_manager.cc:1428] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453: Time spent starting tablet: real 0.024s user 0.019s sys 0.005s
I20260811 06:54:24.033821 10623 heartbeater.cc:503] Master 127.12.145.62:45441 was elected leader, sending a full tablet report...
I20260811 06:54:24.035792 11106 ts_tablet_manager.cc:1428] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: Time spent starting tablet: real 0.032s user 0.025s sys 0.004s
W20260811 06:54:24.160501 11073 tablet.cc:2369] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:54:24.161659 11122 raft_consensus.cc:482] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:24.161959 11122 raft_consensus.cc:504] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3110209846374ef7abcdada3e7aa630f" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35925 } } peers { permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 } } peers { permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 } }
I20260811 06:54:24.163640 11122 leader_election.cc:288] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8043beff984647d59a488ab059163453 (127.12.145.1:35601), f64614a70ad94a059590cb1e6b47dd75 (127.12.145.3:41033)
I20260811 06:54:24.171767 11129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.164677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:41033 (local address 127.12.145.2:38743)
0811 06:54:24.165251 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:24.165265 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:24.165375 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:24.165721 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:24.165724 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:24.165747 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:24.166095 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:24.166103 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.167317 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.167322 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:24.169374 (+ 2052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:24.169386 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.170903 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.170909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:24.171135 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:24.171160 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 06:54:24.171235 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 06:54:24.171363 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":30,"thread_start_us":288,"threads_started":1}
I20260811 06:54:24.171798 11128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.163960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35601 (local address 127.12.145.2:35291)
0811 06:54:24.164595 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:24.164620 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:24.164792 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:24.165305 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:24.165309 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:24.165337 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:24.165753 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:24.165767 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.166969 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.166973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:24.169171 (+ 2198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:24.169186 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.170779 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.170784 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:24.171095 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:24.171148 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 06:54:24.171235 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 06:54:24.171363 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"mutex_wait_us":87,"thread_start_us":315,"threads_started":1}
I20260811 06:54:24.171628 11104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.164818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:38743 (local address 127.12.145.3:41033)
0811 06:54:24.164982 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:24.164987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:24.165355 (+ 368us) server_negotiation.cc:407] Connection header received
0811 06:54:24.165507 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:24.165532 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:24.165607 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:24.165703 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:24.166242 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.167178 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.169564 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.170741 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.170879 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:24.170927 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:24.171285 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 06:54:24.171400 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:54:24.172130 11101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.164117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:35291 (local address 127.12.145.1:35601)
0811 06:54:24.164336 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:24.164344 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:24.164735 (+ 391us) server_negotiation.cc:407] Connection header received
0811 06:54:24.164993 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:24.164999 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:24.165084 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:24.165138 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:24.165904 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.166855 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.169357 (+ 2502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.170609 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.170770 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:24.170843 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:24.171776 (+ 933us) server_negotiation.cc:299] Negotiation successful
0811 06:54:24.171896 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 06:54:24.173125 10996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c48fd8bf45c4c3c8aaf92eb32575ee4" candidate_uuid: "3110209846374ef7abcdada3e7aa630f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f64614a70ad94a059590cb1e6b47dd75" is_pre_election: true
I20260811 06:54:24.173410 10551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c48fd8bf45c4c3c8aaf92eb32575ee4" candidate_uuid: "3110209846374ef7abcdada3e7aa630f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8043beff984647d59a488ab059163453" is_pre_election: true
I20260811 06:54:24.173758 10996 raft_consensus.cc:2454] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3110209846374ef7abcdada3e7aa630f in term 0.
I20260811 06:54:24.173985 10551 raft_consensus.cc:2454] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3110209846374ef7abcdada3e7aa630f in term 0.
I20260811 06:54:24.174476 10656 leader_election.cc:302] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3110209846374ef7abcdada3e7aa630f, f64614a70ad94a059590cb1e6b47dd75; no voters:
I20260811 06:54:24.174862 11122 raft_consensus.cc:2781] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:54:24.174996 11122 raft_consensus.cc:482] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:54:24.175103 11122 raft_consensus.cc:3037] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:24.177235 11122 raft_consensus.cc:504] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3110209846374ef7abcdada3e7aa630f" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35925 } } peers { permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 } } peers { permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 } }
I20260811 06:54:24.177802 11122 leader_election.cc:288] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [CANDIDATE]: Term 1 election: Requested vote from peers 8043beff984647d59a488ab059163453 (127.12.145.1:35601), f64614a70ad94a059590cb1e6b47dd75 (127.12.145.3:41033)
I20260811 06:54:24.178263 10551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c48fd8bf45c4c3c8aaf92eb32575ee4" candidate_uuid: "3110209846374ef7abcdada3e7aa630f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8043beff984647d59a488ab059163453"
I20260811 06:54:24.178390 10996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c48fd8bf45c4c3c8aaf92eb32575ee4" candidate_uuid: "3110209846374ef7abcdada3e7aa630f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f64614a70ad94a059590cb1e6b47dd75"
I20260811 06:54:24.178460 10551 raft_consensus.cc:3037] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:24.178580 10996 raft_consensus.cc:3037] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:24.181635 10551 raft_consensus.cc:2454] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3110209846374ef7abcdada3e7aa630f in term 1.
I20260811 06:54:24.181627 10996 raft_consensus.cc:2454] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3110209846374ef7abcdada3e7aa630f in term 1.
I20260811 06:54:24.182010 10656 leader_election.cc:302] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3110209846374ef7abcdada3e7aa630f, f64614a70ad94a059590cb1e6b47dd75; no voters:
I20260811 06:54:24.182265 11122 raft_consensus.cc:2781] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:24.182672 11122 raft_consensus.cc:686] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 1 LEADER]: Becoming Leader. State: Replica: 3110209846374ef7abcdada3e7aa630f, State: Running, Role: LEADER
I20260811 06:54:24.183112 11122 consensus_queue.cc:237] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3110209846374ef7abcdada3e7aa630f" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35925 } } peers { permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 } } peers { permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 } }
I20260811 06:54:24.187673 10326 catalog_manager.cc:5495] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f reported cstate change: term changed from 0 to 1, leader changed from <none> to 3110209846374ef7abcdada3e7aa630f (127.12.145.2). New cstate: current_term: 1 leader_uuid: "3110209846374ef7abcdada3e7aa630f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3110209846374ef7abcdada3e7aa630f" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 35925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 } health_report { overall_health: UNKNOWN } } }
W20260811 06:54:24.217532 10844 tablet.cc:2369] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:54:24.230829 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.225339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39254 (local address 127.12.145.2:35925)
0811 06:54:24.225587 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:24.225593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:24.225672 (+ 79us) server_negotiation.cc:407] Connection header received
0811 06:54:24.225892 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:24.225897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:24.225986 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:24.226121 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:54:24.226500 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.227200 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.228631 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.229065 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.229175 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:24.229721 (+ 546us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:54:24.230229 (+ 508us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:54:24.230370 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:24.230481 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 06:54:24.230571 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 06:54:24.239359 10551 raft_consensus.cc:1261] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453 [term 1 FOLLOWER]: Refusing update from remote peer 3110209846374ef7abcdada3e7aa630f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:24.239362 10996 raft_consensus.cc:1261] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75 [term 1 FOLLOWER]: Refusing update from remote peer 3110209846374ef7abcdada3e7aa630f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:24.240307 11131 consensus_queue.cc:1035] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f64614a70ad94a059590cb1e6b47dd75" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 41033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:24.240664 11122 consensus_queue.cc:1035] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8043beff984647d59a488ab059163453" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 35601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:24.264523 10326 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:24.264811 10326 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:24.268133 10326 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77df5b33dc9242c59ec4f0c0af256113: Sending DeleteTablet for 3 replicas of tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4
I20260811 06:54:24.269389 10739 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:24 UTC) from {username='slave'} at 127.0.0.1:39252
I20260811 06:54:24.269654 10524 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:24 UTC) from {username='slave'} at 127.0.0.1:52922
I20260811 06:54:24.270236 10960 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:24 UTC) from {username='slave'} at 127.0.0.1:41376
I20260811 06:54:24.271636 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 10419
I20260811 06:54:24.284228 11159 tablet_replica.cc:330] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: stopping tablet replica
I20260811 06:54:24.284951 11159 raft_consensus.cc:2229] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:24.285660 11159 raft_consensus.cc:2258] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:24.288244 11159 ts_tablet_manager.cc:1905] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:24.295146 11157 tablet_replica.cc:330] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453: stopping tablet replica
I20260811 06:54:24.295616 11157 raft_consensus.cc:2229] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:24.296166 11157 raft_consensus.cc:2258] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:24.296207 11159 ts_tablet_manager.cc:1918] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:24.296490 11159 log.cc:1196] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/4c48fd8bf45c4c3c8aaf92eb32575ee4
I20260811 06:54:24.297171 11159 ts_tablet_manager.cc:1939] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P f64614a70ad94a059590cb1e6b47dd75: Deleting consensus metadata
I20260811 06:54:24.299302 10304 catalog_manager.cc:4841] TS f64614a70ad94a059590cb1e6b47dd75 (127.12.145.3:41033): tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4 (table test-table [id=b080fa8bc30741b6900533dac49bb4b0]) successfully deleted
I20260811 06:54:24.302039 11155 tablet_replica.cc:330] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: stopping tablet replica
I20260811 06:54:24.302484 11155 raft_consensus.cc:2229] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:54:24.303278 11155 raft_consensus.cc:2258] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:24.303517 11157 ts_tablet_manager.cc:1905] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 8043beff984647d59a488ab059163453: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:24.304775 11101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.273317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52928 (local address 127.12.145.1:35601)
0811 06:54:24.273559 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:24.273566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:24.293246 (+ 19680us) server_negotiation.cc:407] Connection header received
0811 06:54:24.293801 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:24.293808 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:24.293952 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:24.294038 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:24.296541 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.297769 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.300168 (+ 2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.300854 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.300954 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:24.303056 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:24.303068 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:24.303086 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:24.303847 (+ 761us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:24.303910 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:24.303936 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:24.304022 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:24.304272 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 06:54:24.304409 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 06:54:24.305301 11155 ts_tablet_manager.cc:1905] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:24.305990 10618 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:24.313541 11155 ts_tablet_manager.cc:1918] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:24.313726 11155 log.cc:1196] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/4c48fd8bf45c4c3c8aaf92eb32575ee4
I20260811 06:54:24.314270 11155 ts_tablet_manager.cc:1939] T 4c48fd8bf45c4c3c8aaf92eb32575ee4 P 3110209846374ef7abcdada3e7aa630f: Deleting consensus metadata
I20260811 06:54:24.316079 10304 catalog_manager.cc:4841] TS 3110209846374ef7abcdada3e7aa630f (127.12.145.2:35925): tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4 (table test-table [id=b080fa8bc30741b6900533dac49bb4b0]) successfully deleted
I20260811 06:54:24.397658 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 10419
W20260811 06:54:24.427991 10304 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.1:35601 (error 108)
I20260811 06:54:24.428413 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 10632
I20260811 06:54:24.431968 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.431427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35601 (local address 127.0.0.1:52944)
0811 06:54:24.431687 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:24.431794 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260811 06:54:24.432197 10304 catalog_manager.cc:4584] TS 8043beff984647d59a488ab059163453 (127.12.145.1:35601): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4c48fd8bf45c4c3c8aaf92eb32575ee4: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35601: connect: Connection refused (error 111)
I20260811 06:54:24.439074 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.429649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39266 (local address 127.12.145.2:35925)
0811 06:54:24.429856 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:24.429862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:24.430620 (+ 758us) server_negotiation.cc:407] Connection header received
0811 06:54:24.430693 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:24.430699 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:24.430809 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:24.430905 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:24.431544 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.432732 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.434889 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.435549 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.435664 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:24.437055 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:24.437071 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:24.437094 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:24.437925 (+ 831us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:24.437986 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:24.438019 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:24.438116 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:24.438606 (+ 490us) server_negotiation.cc:299] Negotiation successful
0811 06:54:24.438704 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 06:54:24.439822 10835 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:24.485677 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.485119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35601 (local address 127.0.0.1:52956)
0811 06:54:24.485354 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:24.485466 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 06:54:24.486794 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.486402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35601 (local address 127.0.0.1:52964)
0811 06:54:24.486550 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:24.486637 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 06:54:24.547536 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.546956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35601 (local address 127.0.0.1:52974)
0811 06:54:24.547236 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:24.547352 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260811 06:54:24.548646 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.548252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35601 (local address 127.0.0.1:52980)
0811 06:54:24.548395 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:24.548479 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 06:54:24.552064 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 10632
I20260811 06:54:24.578086 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 10850
I20260811 06:54:24.584607 11104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.579028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41382 (local address 127.12.145.3:41033)
0811 06:54:24.579201 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:24.579206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:24.579225 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:54:24.579318 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:24.579322 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:24.579405 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:24.579485 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:24.579884 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.580591 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.581929 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:24.582303 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:24.582393 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:24.583349 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:24.583357 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:24.583372 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:24.583933 (+ 561us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:24.583993 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:24.584014 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:24.584097 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:24.584216 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 06:54:24.584300 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:54:24.585265 11060 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:24.629359 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.628770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35601 (local address 127.0.0.1:52986)
0811 06:54:24.629068 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:24.629184 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260811 06:54:24.630550 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:24.630069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:35601 (local address 127.0.0.1:52988)
0811 06:54:24.630267 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:24.630366 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:35601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260811 06:54:24.671707 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 10850
I20260811 06:54:24.693619 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 10266
I20260811 06:54:24.694731 10374 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:24.805190 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 10266
2026-08-11T06:54:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2887 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:24 dist-test-slave-7lbf krb5kdc[11179](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:24 dist-test-slave-7lbf krb5kdc[11179](info): set up 2 sockets
Aug 11 06:54:24 dist-test-slave-7lbf krb5kdc[11179](info): commencing operation
krb5kdc: starting...
W20260811 06:54:26.042375 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:26 dist-test-slave-7lbf krb5kdc[11179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:54:26.319044 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43047
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:43047
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:26.649269 11195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:26.649602 11195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:26.649712 11195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:26.656858 11195 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:26.656957 11195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:26.657018 11195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:26.657074 11195 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:26.657117 11195 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:26.666760 11195 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:43047
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:26.668027 11195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:26.669250 11195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:26.680837 11203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:26.680809 11206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:26.680895 11208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:26.681589 11195 server_base.cc:1034] running on GCE node
I20260811 06:54:26.682337 11195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:26.683759 11195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:26.684973 11195 hybrid_clock.cc:648] HybridClock initialized: now 1786431266684907 us; error 51 us; skew 500 ppm
I20260811 06:54:26.685299 11195 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:26 dist-test-slave-7lbf krb5kdc[11179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431266, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:26.688302 11195 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:54:26.689813 11195 webserver.cc:460] Webserver started at http://127.12.145.62:43863/ using document root <none> and password file <none>
I20260811 06:54:26.690459 11195 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:26.690578 11195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:26.690843 11195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:26.693812 11195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d"
format_stamp: "Formatted at 2026-08-11 06:54:26 on dist-test-slave-7lbf"
server_key: "678459e7a748272f67213b8573c304b5"
server_key_iv: "5d65ff6f61ebed6c2ddc2227ddb4979d"
server_key_version: "encryptionkey@0"
I20260811 06:54:26.694576 11195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d"
format_stamp: "Formatted at 2026-08-11 06:54:26 on dist-test-slave-7lbf"
server_key: "678459e7a748272f67213b8573c304b5"
server_key_iv: "5d65ff6f61ebed6c2ddc2227ddb4979d"
server_key_version: "encryptionkey@0"
I20260811 06:54:26.699894 11195 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:54:26.703449 11222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:26.704768 11195 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:54:26.704916 11195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d"
format_stamp: "Formatted at 2026-08-11 06:54:26 on dist-test-slave-7lbf"
server_key: "678459e7a748272f67213b8573c304b5"
server_key_iv: "5d65ff6f61ebed6c2ddc2227ddb4979d"
server_key_version: "encryptionkey@0"
I20260811 06:54:26.705093 11195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:26.727402 11195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:26.731405 11195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:26.731634 11195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:26.749457 11195 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:43047
I20260811 06:54:26.749480 11317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:43047 every 8 connection(s)
I20260811 06:54:26.750880 11195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:26.754629 11318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:26.755620 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 11195
I20260811 06:54:26.755774 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:26.756245 12868 external_mini_cluster.cc:1428] Setting key 4dae73cd8d620d054d0b11af59e92e9f
I20260811 06:54:26.768232 11318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d: Bootstrap starting.
Aug 11 06:54:26 dist-test-slave-7lbf krb5kdc[11179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:26.771862 11318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:26.773026 11318 log.cc:824] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:26.776149 11318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d: No bootstrap required, opened a new log
I20260811 06:54:26.779317 11321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:26.758057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55402 (local address 127.12.145.62:43047)
0811 06:54:26.758809 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:26.758821 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:26.758866 (+ 45us) server_negotiation.cc:407] Connection header received
0811 06:54:26.760558 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:26.760582 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:26.760980 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:26.761319 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:26.763201 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:26.764486 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:26.766369 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:26.767031 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:26.767158 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:26.771913 (+ 4755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:26.771922 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:26.771943 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:26.772001 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:26.775216 (+ 3215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:26.776097 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:26.776104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:26.776110 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:26.776299 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:26.776722 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:26.776725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:26.776727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:26.777230 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:26.777447 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:26.777955 (+ 508us) server_negotiation.cc:299] Negotiation successful
0811 06:54:26.778302 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":320,"threads_started":1}
I20260811 06:54:26.783986 11318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43047 } }
I20260811 06:54:26.784329 11318 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:26.784418 11318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3059bde0a14f40f4bd3e07f3f23b1a6d, State: Initialized, Role: FOLLOWER
I20260811 06:54:26.784922 11318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43047 } }
I20260811 06:54:26.785143 11318 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:26.785264 11318 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:26.785427 11318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:26.787928 11318 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43047 } }
I20260811 06:54:26.788404 11318 leader_election.cc:302] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3059bde0a14f40f4bd3e07f3f23b1a6d; no voters:
I20260811 06:54:26.789849 11318 leader_election.cc:288] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:26.789958 11323 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:26.790526 11323 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [term 1 LEADER]: Becoming Leader. State: Replica: 3059bde0a14f40f4bd3e07f3f23b1a6d, State: Running, Role: LEADER
I20260811 06:54:26.791162 11323 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43047 } }
I20260811 06:54:26.794283 11318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:26.794152 11325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43047 } } }
I20260811 06:54:26.794559 11325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:26.794471 11324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3059bde0a14f40f4bd3e07f3f23b1a6d. Latest consensus state: current_term: 1 leader_uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3059bde0a14f40f4bd3e07f3f23b1a6d" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43047 } } }
I20260811 06:54:26.794766 11324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:26.795508 11328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:26.801020 11328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:26.811376 11328 catalog_manager.cc:1347] Generated new cluster ID: d802664897fe413189ad9dad508c207c
I20260811 06:54:26.811498 11328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:26.824003 11328 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:26.825855 11328 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:26.836484 11328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d: Generated new TSK 0
I20260811 06:54:26.837457 11328 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:54:26.908453 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43047
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:27.238428 11352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:27.238723 11352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:27.238869 11352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:27.245980 11352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:27.246091 11352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:27.246236 11352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:54:27.255767 11352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43047
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:27.256999 11352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:27.258291 11352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:27.271041 11361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:27.270884 11367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:27.271087 11362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:27.272151 11352 server_base.cc:1034] running on GCE node
I20260811 06:54:27.272768 11352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:27.273699 11352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:27.274916 11352 hybrid_clock.cc:648] HybridClock initialized: now 1786431267274866 us; error 44 us; skew 500 ppm
I20260811 06:54:27.275214 11352 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:27 dist-test-slave-7lbf krb5kdc[11179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431267, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:27.278353 11352 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:54:27.280015 11352 webserver.cc:460] Webserver started at http://127.12.145.1:36473/ using document root <none> and password file <none>
I20260811 06:54:27.280637 11352 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:27.280756 11352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:27.281067 11352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:27.283946 11352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "c7f89fb53d6249cfae04fe1346a77a15"
format_stamp: "Formatted at 2026-08-11 06:54:27 on dist-test-slave-7lbf"
server_key: "79eba901977a384c095910c24fe6f79e"
server_key_iv: "8e6819857c128061d8cb39aca87d5982"
server_key_version: "encryptionkey@0"
I20260811 06:54:27.284677 11352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "c7f89fb53d6249cfae04fe1346a77a15"
format_stamp: "Formatted at 2026-08-11 06:54:27 on dist-test-slave-7lbf"
server_key: "79eba901977a384c095910c24fe6f79e"
server_key_iv: "8e6819857c128061d8cb39aca87d5982"
server_key_version: "encryptionkey@0"
I20260811 06:54:27.290315 11352 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 06:54:27.293640 11383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:27.294934 11352 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:54:27.295099 11352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "c7f89fb53d6249cfae04fe1346a77a15"
format_stamp: "Formatted at 2026-08-11 06:54:27 on dist-test-slave-7lbf"
server_key: "79eba901977a384c095910c24fe6f79e"
server_key_iv: "8e6819857c128061d8cb39aca87d5982"
server_key_version: "encryptionkey@0"
I20260811 06:54:27.295316 11352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:27.315030 11352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:27.318962 11352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:27.319216 11352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:27.320143 11352 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:27.321413 11352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:27.321492 11352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:27.321638 11352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:27.321692 11352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:27.351734 11352 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:36669
I20260811 06:54:27.351784 11576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:36669 every 8 connection(s)
I20260811 06:54:27.352972 11352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:54:27.357134 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 11352
I20260811 06:54:27.357291 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:54:27.357750 12868 external_mini_cluster.cc:1428] Setting key 53c1832bbd50126623733ae865ccddb4
Aug 11 06:54:27 dist-test-slave-7lbf krb5kdc[11179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431267, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:27.372807 11580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:27.355453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:55533 (local address 127.12.145.62:43047)
0811 06:54:27.355916 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:27.355921 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:27.356881 (+ 960us) server_negotiation.cc:407] Connection header received
0811 06:54:27.358755 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:27.358760 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:27.358827 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:27.358918 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:27.360455 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:27.361159 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:27.362712 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:27.363115 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:27.363229 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:27.366619 (+ 3390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:27.366625 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:27.366630 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:27.366668 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:27.369770 (+ 3102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:27.370492 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:27.370497 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:27.370500 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:27.370657 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:27.371126 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:27.371130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:27.371132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:27.371444 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:27.371591 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:27.372343 (+ 752us) server_negotiation.cc:299] Negotiation successful
0811 06:54:27.372544 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":225,"threads_started":1}
I20260811 06:54:27.374166 11581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:27.355988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43047 (local address 127.12.145.1:55533)
0811 06:54:27.356690 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:27.356729 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:27.358519 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:27.359173 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:27.359184 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:27.359745 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:27.360276 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:27.360304 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:27.361317 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:27.361321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:27.362573 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:27.362586 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:27.363349 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:27.363356 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:27.363567 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:27.364151 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:27.364178 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:27.366407 (+ 2229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:27.369913 (+ 3506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:27.369920 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:27.369931 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:27.370355 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:27.370783 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:27.370810 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:27.370813 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:27.371010 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:27.371605 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:27.371611 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:27.371962 (+ 351us) client_negotiation.cc:769] Sending connection context
0811 06:54:27.372252 (+ 290us) client_negotiation.cc:240] Negotiation successful
0811 06:54:27.372790 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":273,"threads_started":1}
I20260811 06:54:27.375730 11578 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43047
I20260811 06:54:27.376065 11578 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:27.376869 11578 heartbeater.cc:511] Master 127.12.145.62:43047 requested a full tablet report, sending...
I20260811 06:54:27.379330 11249 ts_manager.cc:194] Registered new tserver with Master: c7f89fb53d6249cfae04fe1346a77a15 (127.12.145.1:36669)
I20260811 06:54:27.381232 11249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:55533
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:54:27.425019 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43047
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:27.751748 11586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:27.752022 11586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:27.752156 11586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:27.759230 11586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:27.759356 11586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:27.759522 11586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:54:27.769011 11586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43047
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:27.770285 11586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:27.771605 11586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:27.784266 11596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:27.784245 11602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:27.784193 11597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:27.785040 11586 server_base.cc:1034] running on GCE node
I20260811 06:54:27.785697 11586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:27.786610 11586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:27.787834 11586 hybrid_clock.cc:648] HybridClock initialized: now 1786431267787761 us; error 33 us; skew 500 ppm
I20260811 06:54:27.788128 11586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:27 dist-test-slave-7lbf krb5kdc[11179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431267, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:27.794289 11586 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:54:27.795845 11586 webserver.cc:460] Webserver started at http://127.12.145.2:41457/ using document root <none> and password file <none>
I20260811 06:54:27.796547 11586 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:27.796674 11586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:27.797011 11586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:27.800117 11586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "e936ec7350ca4c5cb73bbc88f1677829"
format_stamp: "Formatted at 2026-08-11 06:54:27 on dist-test-slave-7lbf"
server_key: "e704bd3fe3953b9af36903f1457af90b"
server_key_iv: "7f1822c93857ce6de0c80680f57e63ef"
server_key_version: "encryptionkey@0"
I20260811 06:54:27.800906 11586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "e936ec7350ca4c5cb73bbc88f1677829"
format_stamp: "Formatted at 2026-08-11 06:54:27 on dist-test-slave-7lbf"
server_key: "e704bd3fe3953b9af36903f1457af90b"
server_key_iv: "7f1822c93857ce6de0c80680f57e63ef"
server_key_version: "encryptionkey@0"
I20260811 06:54:27.806371 11586 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 06:54:27.809955 11617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:27.811302 11586 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:54:27.811446 11586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "e936ec7350ca4c5cb73bbc88f1677829"
format_stamp: "Formatted at 2026-08-11 06:54:27 on dist-test-slave-7lbf"
server_key: "e704bd3fe3953b9af36903f1457af90b"
server_key_iv: "7f1822c93857ce6de0c80680f57e63ef"
server_key_version: "encryptionkey@0"
I20260811 06:54:27.811621 11586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:27.834180 11586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:27.838600 11586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:27.838864 11586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:27.839920 11586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:27.841445 11586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:27.841553 11586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 06:54:27.841670 11586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:27.841718 11586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:27.870501 11586 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:45307
I20260811 06:54:27.870570 11808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:45307 every 8 connection(s)
I20260811 06:54:27.871851 11586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:54:27.881699 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 11586
I20260811 06:54:27.881896 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:54:27.882397 12868 external_mini_cluster.cc:1428] Setting key cd2e9715c9bf11b0d94329db6f50d321
Aug 11 06:54:27 dist-test-slave-7lbf krb5kdc[11179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431267, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:27.892800 11814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:27.874366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:56927 (local address 127.12.145.62:43047)
0811 06:54:27.874809 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:27.874813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:27.875793 (+ 980us) server_negotiation.cc:407] Connection header received
0811 06:54:27.877786 (+ 1993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:27.877791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:27.877883 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:27.877991 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:27.879495 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:27.880216 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:27.882114 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:27.882630 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:27.882746 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:27.886667 (+ 3921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:27.886673 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:27.886677 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:27.886714 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:27.889417 (+ 2703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:27.890242 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:27.890247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:27.890250 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:27.890398 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:27.890891 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:27.890895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:27.890897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:27.891187 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:27.891339 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:27.892108 (+ 769us) server_negotiation.cc:299] Negotiation successful
0811 06:54:27.892355 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":239,"threads_started":1}
I20260811 06:54:27.893839 11817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:27.874927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43047 (local address 127.12.145.2:56927)
0811 06:54:27.875633 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:27.875677 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:27.877486 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:27.878248 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:27.878256 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:27.878765 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:27.879315 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:27.879333 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:27.880373 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:27.880377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:27.881955 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:27.881971 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:27.882889 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:27.882898 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:27.883120 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:27.883801 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:27.883829 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:27.886402 (+ 2573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:27.889604 (+ 3202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:27.889614 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:27.889634 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:27.890099 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:27.890518 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:27.890524 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:27.890540 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:27.890758 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:27.891336 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:27.891345 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:27.891708 (+ 363us) client_negotiation.cc:769] Sending connection context
0811 06:54:27.891979 (+ 271us) client_negotiation.cc:240] Negotiation successful
0811 06:54:27.892555 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":277,"threads_started":1}
I20260811 06:54:27.895423 11809 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43047
I20260811 06:54:27.895732 11809 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:27.896464 11809 heartbeater.cc:511] Master 127.12.145.62:43047 requested a full tablet report, sending...
I20260811 06:54:27.898007 11249 ts_manager.cc:194] Registered new tserver with Master: e936ec7350ca4c5cb73bbc88f1677829 (127.12.145.2:45307)
I20260811 06:54:27.899112 11249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:56927
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:54:27.946228 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43047
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:39977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:28.279085 11820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:28.279354 11820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:28.279495 11820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:28.286603 11820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:28.286715 11820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:28.286859 11820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:54:28.297039 11820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:39977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:43047
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:28.298738 11820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:28.300196 11820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:28.316800 11832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:28.317001 11834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:28.317353 11831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:28.317644 11820 server_base.cc:1034] running on GCE node
I20260811 06:54:28.318352 11820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:28.321074 11820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:28.322296 11820 hybrid_clock.cc:648] HybridClock initialized: now 1786431268322228 us; error 55 us; skew 500 ppm
I20260811 06:54:28.322712 11820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:28 dist-test-slave-7lbf krb5kdc[11179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431268, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:28.326443 11820 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:54:28.328028 11820 webserver.cc:460] Webserver started at http://127.12.145.3:38475/ using document root <none> and password file <none>
I20260811 06:54:28.328822 11820 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:28.328938 11820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:28.329237 11820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:28.332815 11820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f"
format_stamp: "Formatted at 2026-08-11 06:54:28 on dist-test-slave-7lbf"
server_key: "5155aa4595b925400cc6af8ef7f86342"
server_key_iv: "6ddba63ac7ad3bb6f0bc69a99680d36b"
server_key_version: "encryptionkey@0"
I20260811 06:54:28.333889 11820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f"
format_stamp: "Formatted at 2026-08-11 06:54:28 on dist-test-slave-7lbf"
server_key: "5155aa4595b925400cc6af8ef7f86342"
server_key_iv: "6ddba63ac7ad3bb6f0bc69a99680d36b"
server_key_version: "encryptionkey@0"
I20260811 06:54:28.341130 11820 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260811 06:54:28.346074 11849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:28.347815 11820 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 06:54:28.348016 11820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f"
format_stamp: "Formatted at 2026-08-11 06:54:28 on dist-test-slave-7lbf"
server_key: "5155aa4595b925400cc6af8ef7f86342"
server_key_iv: "6ddba63ac7ad3bb6f0bc69a99680d36b"
server_key_version: "encryptionkey@0"
I20260811 06:54:28.348289 11820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:28.371129 11820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:28.375511 11820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:28.375797 11820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:28.376765 11820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:28.378255 11820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:28.378338 11820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:28.378446 11820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:28.378495 11820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:28.384759 11578 heartbeater.cc:503] Master 127.12.145.62:43047 was elected leader, sending a full tablet report...
I20260811 06:54:28.411585 11820 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:46717
I20260811 06:54:28.411623 12037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:46717 every 8 connection(s)
I20260811 06:54:28.412946 11820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:54:28.418241 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 11820
I20260811 06:54:28.418422 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:54:28.418908 12868 external_mini_cluster.cc:1428] Setting key 7b7f806fbf930f6a26ec85a4ddd24968
Aug 11 06:54:28 dist-test-slave-7lbf krb5kdc[11179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431268, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:28.432963 12041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.415509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:48563 (local address 127.12.145.62:43047)
0811 06:54:28.415938 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:28.415943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:28.416953 (+ 1010us) server_negotiation.cc:407] Connection header received
0811 06:54:28.418853 (+ 1900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:28.418859 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:28.418973 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:28.419076 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:28.421193 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.422427 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.423928 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.424309 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.424410 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.427637 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:28.427641 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:28.427644 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:28.427676 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:28.430043 (+ 2367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:28.430736 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:28.430742 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:28.430744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:28.430862 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:28.431269 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:28.431274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:28.431277 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:28.431550 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:28.431692 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:28.432373 (+ 681us) server_negotiation.cc:299] Negotiation successful
0811 06:54:28.432591 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":203,"threads_started":1}
I20260811 06:54:28.434057 12042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.416009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:43047 (local address 127.12.145.3:48563)
0811 06:54:28.416762 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:28.416805 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:28.418590 (+ 1785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:28.419426 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:28.419437 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:28.420147 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:28.420969 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.420999 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.422579 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.422583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.423802 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.423815 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.424494 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.424499 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.424685 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.425261 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:28.425287 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:28.427438 (+ 2151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:28.430170 (+ 2732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:28.430179 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:28.430195 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:28.430623 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:28.430967 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:28.430972 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:28.430976 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:28.431162 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:28.431676 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:28.431683 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:28.432012 (+ 329us) client_negotiation.cc:769] Sending connection context
0811 06:54:28.432256 (+ 244us) client_negotiation.cc:240] Negotiation successful
0811 06:54:28.432761 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":317,"threads_started":1}
I20260811 06:54:28.435348 12039 heartbeater.cc:347] Connected to a master server at 127.12.145.62:43047
I20260811 06:54:28.435638 12039 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:28.436378 12039 heartbeater.cc:511] Master 127.12.145.62:43047 requested a full tablet report, sending...
I20260811 06:54:28.437716 11249 ts_manager.cc:194] Registered new tserver with Master: ffa78dbb57f04b7a9d8f19532dca6f8f (127.12.145.3:46717)
I20260811 06:54:28.438500 11249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:48563
I20260811 06:54:28.446707 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:54:28.463414 12041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.450714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60426 (local address 127.12.145.62:43047)
0811 06:54:28.450875 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:28.450879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:28.451317 (+ 438us) server_negotiation.cc:407] Connection header received
0811 06:54:28.451451 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:28.451454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:28.451514 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:28.451593 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:28.452904 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.453750 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.455177 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.455597 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.455693 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.458364 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:28.458370 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:28.458373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:28.458408 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:28.460795 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:28.461604 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:28.461609 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:28.461612 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:28.461744 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:28.462206 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:28.462211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:28.462213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:28.462548 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:28.462758 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:28.463028 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 06:54:28.463177 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 06:54:28.467330 11249 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60426:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:54:28.474315 11249 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:54:28.496959 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.486938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54718 (local address 127.12.145.3:46717)
0811 06:54:28.487630 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:28.487640 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:28.488299 (+ 659us) server_negotiation.cc:407] Connection header received
0811 06:54:28.488726 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:28.488735 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:28.488985 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:28.489148 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:28.490917 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.492401 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.494733 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.495784 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.495901 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.496144 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:28.496453 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 06:54:28.496640 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":878,"threads_started":1}
I20260811 06:54:28.497017 12059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.486807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:46717 (local address 127.0.0.1:54718)
0811 06:54:28.488139 (+ 1332us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:28.488178 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:28.488458 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:28.489510 (+ 1052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:28.489540 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:28.489572 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:28.490694 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.490707 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.492543 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.492549 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.494555 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.494569 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.495986 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.495992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.496190 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.496249 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 06:54:28.496361 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 06:54:28.496562 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1096,"mutex_wait_us":2,"thread_start_us":971,"threads_started":1}
I20260811 06:54:28.497413 12062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.487334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:36669 (local address 127.0.0.1:45448)
0811 06:54:28.488428 (+ 1094us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:28.488448 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:28.488574 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:28.489731 (+ 1157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:28.489740 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:28.489772 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:28.490290 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.490304 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.491987 (+ 1683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.491993 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.494300 (+ 2307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.494316 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.496204 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.496211 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.496393 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.496427 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 06:54:28.496495 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 06:54:28.496628 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":966,"mutex_wait_us":27,"thread_start_us":813,"threads_started":1}
I20260811 06:54:28.498310 12066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.488588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:45307 (local address 127.0.0.1:34148)
0811 06:54:28.490174 (+ 1586us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:28.490191 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:28.490399 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:28.491139 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:28.491143 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:28.491170 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:28.491539 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.491550 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.493066 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.493075 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.495255 (+ 2180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.495272 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.497494 (+ 2222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.497502 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.497714 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.497748 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 06:54:28.497839 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 06:54:28.497964 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1450,"mutex_wait_us":3,"thread_start_us":1290,"threads_started":1}
I20260811 06:54:28.498394 12065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.487834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45448 (local address 127.12.145.1:36669)
0811 06:54:28.489133 (+ 1299us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:28.489139 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:28.489160 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:54:28.489232 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:28.489238 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:28.489470 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:28.490203 (+ 733us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:28.490468 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.491827 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.494493 (+ 2666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.495956 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.497332 (+ 1376us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.497575 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:28.497653 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 06:54:28.498054 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1163,"thread_start_us":1003,"threads_started":1}
I20260811 06:54:28.499053 12068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.489071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34148 (local address 127.12.145.2:45307)
0811 06:54:28.489684 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:28.489693 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:28.490293 (+ 600us) server_negotiation.cc:407] Connection header received
0811 06:54:28.490607 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:28.490615 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:28.490824 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:28.490995 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:28.491697 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.492912 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.495486 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.496893 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.497030 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.497231 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:28.498559 (+ 1328us) server_negotiation.cc:299] Negotiation successful
0811 06:54:28.498725 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":280,"threads_started":1}
I20260811 06:54:28.501889 11924 tablet_service.cc:1467] Processing CreateTablet for tablet 687faaf4192f459c95c0e15fa1d5e99d (DEFAULT_TABLE table=test-table [id=6c559685c8de4f619e2b2a3e682e3e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:28.501899 11458 tablet_service.cc:1467] Processing CreateTablet for tablet 687faaf4192f459c95c0e15fa1d5e99d (DEFAULT_TABLE table=test-table [id=6c559685c8de4f619e2b2a3e682e3e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:28.502290 11696 tablet_service.cc:1467] Processing CreateTablet for tablet 687faaf4192f459c95c0e15fa1d5e99d (DEFAULT_TABLE table=test-table [id=6c559685c8de4f619e2b2a3e682e3e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:28.503449 11458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 687faaf4192f459c95c0e15fa1d5e99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:28.503472 11924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 687faaf4192f459c95c0e15fa1d5e99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:28.503582 11696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 687faaf4192f459c95c0e15fa1d5e99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:28.515051 12070 tablet_bootstrap.cc:492] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: Bootstrap starting.
I20260811 06:54:28.519397 12070 tablet_bootstrap.cc:654] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:28.520440 12070 log.cc:824] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:28.521435 12072 tablet_bootstrap.cc:492] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: Bootstrap starting.
I20260811 06:54:28.522368 12073 tablet_bootstrap.cc:492] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: Bootstrap starting.
I20260811 06:54:28.524848 12070 tablet_bootstrap.cc:492] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: No bootstrap required, opened a new log
I20260811 06:54:28.525138 12070 ts_tablet_manager.cc:1397] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260811 06:54:28.526232 12073 tablet_bootstrap.cc:654] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:28.526237 12072 tablet_bootstrap.cc:654] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:28.527562 12072 log.cc:824] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:28.527891 12073 log.cc:824] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:28.530817 12073 tablet_bootstrap.cc:492] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: No bootstrap required, opened a new log
I20260811 06:54:28.531081 12073 ts_tablet_manager.cc:1397] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 06:54:28.531287 12072 tablet_bootstrap.cc:492] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: No bootstrap required, opened a new log
I20260811 06:54:28.531576 12072 ts_tablet_manager.cc:1397] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 06:54:28.534762 12070 raft_consensus.cc:348] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 } } peers { permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 } } peers { permanent_uuid: "c7f89fb53d6249cfae04fe1346a77a15" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36669 } }
I20260811 06:54:28.535214 12070 raft_consensus.cc:374] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:28.535313 12070 raft_consensus.cc:729] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e936ec7350ca4c5cb73bbc88f1677829, State: Initialized, Role: FOLLOWER
I20260811 06:54:28.535974 12070 consensus_queue.cc:260] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 } } peers { permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 } } peers { permanent_uuid: "c7f89fb53d6249cfae04fe1346a77a15" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36669 } }
I20260811 06:54:28.537132 11809 heartbeater.cc:503] Master 127.12.145.62:43047 was elected leader, sending a full tablet report...
I20260811 06:54:28.537845 12070 ts_tablet_manager.cc:1428] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
I20260811 06:54:28.538985 12073 raft_consensus.cc:348] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 } } peers { permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 } } peers { permanent_uuid: "c7f89fb53d6249cfae04fe1346a77a15" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36669 } }
I20260811 06:54:28.539379 12073 raft_consensus.cc:374] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:28.539486 12073 raft_consensus.cc:729] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7f89fb53d6249cfae04fe1346a77a15, State: Initialized, Role: FOLLOWER
I20260811 06:54:28.540027 12073 consensus_queue.cc:260] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 } } peers { permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 } } peers { permanent_uuid: "c7f89fb53d6249cfae04fe1346a77a15" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36669 } }
I20260811 06:54:28.541694 12073 ts_tablet_manager.cc:1428] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260811 06:54:28.541821 12072 raft_consensus.cc:348] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 } } peers { permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 } } peers { permanent_uuid: "c7f89fb53d6249cfae04fe1346a77a15" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36669 } }
I20260811 06:54:28.542176 12072 raft_consensus.cc:374] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:28.542272 12072 raft_consensus.cc:729] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffa78dbb57f04b7a9d8f19532dca6f8f, State: Initialized, Role: FOLLOWER
I20260811 06:54:28.542871 12072 consensus_queue.cc:260] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 } } peers { permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 } } peers { permanent_uuid: "c7f89fb53d6249cfae04fe1346a77a15" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36669 } }
I20260811 06:54:28.545413 12039 heartbeater.cc:503] Master 127.12.145.62:43047 was elected leader, sending a full tablet report...
I20260811 06:54:28.545853 12072 ts_tablet_manager.cc:1428] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: Time spent starting tablet: real 0.014s user 0.015s sys 0.001s
W20260811 06:54:28.605238 11579 tablet.cc:2369] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:54:28.623821 11810 tablet.cc:2369] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:54:28.664659 12040 tablet.cc:2369] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:54:28.758271 12086 raft_consensus.cc:482] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:28.758664 12086 raft_consensus.cc:504] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 } } peers { permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 } } peers { permanent_uuid: "c7f89fb53d6249cfae04fe1346a77a15" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36669 } }
I20260811 06:54:28.760810 12086 leader_election.cc:288] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffa78dbb57f04b7a9d8f19532dca6f8f (127.12.145.3:46717), e936ec7350ca4c5cb73bbc88f1677829 (127.12.145.2:45307)
I20260811 06:54:28.767519 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.761321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:45455 (local address 127.12.145.3:46717)
0811 06:54:28.761596 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:28.761603 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:28.762109 (+ 506us) server_negotiation.cc:407] Connection header received
0811 06:54:28.762372 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:28.762380 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:28.762501 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:28.762576 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:28.763357 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.764098 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.765881 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.766645 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.766799 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.766877 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:28.767150 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 06:54:28.767275 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 06:54:28.767585 12088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.761224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:46717 (local address 127.12.145.1:45455)
0811 06:54:28.761996 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:28.762016 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:28.762177 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:28.762814 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:28.762819 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:28.762860 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:28.763208 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.763219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.764231 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.764235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.765724 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.765740 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.766846 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.766852 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.766997 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.767021 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 06:54:28.767104 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 06:54:28.767230 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":433,"threads_started":1}
I20260811 06:54:28.768160 12089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.762205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:45307 (local address 127.12.145.1:49179)
0811 06:54:28.763122 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:28.763137 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:28.763280 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:28.763584 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:28.763589 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:28.763613 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:28.763941 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.763950 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.764909 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.764913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.766333 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:28.766346 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.767504 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.767511 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:28.767676 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.767711 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 06:54:28.767800 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 06:54:28.767915 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"thread_start_us":593,"threads_started":1}
I20260811 06:54:28.768230 12068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.762464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:49179 (local address 127.12.145.2:45307)
0811 06:54:28.762663 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:28.762668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:28.763250 (+ 582us) server_negotiation.cc:407] Connection header received
0811 06:54:28.763412 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:28.763417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:28.763476 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:28.763552 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:28.764096 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.764770 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.766490 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.767280 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.767420 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.767491 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:28.767856 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 06:54:28.767988 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 06:54:28.768790 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "687faaf4192f459c95c0e15fa1d5e99d" candidate_uuid: "c7f89fb53d6249cfae04fe1346a77a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" is_pre_election: true
I20260811 06:54:28.769179 11731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "687faaf4192f459c95c0e15fa1d5e99d" candidate_uuid: "c7f89fb53d6249cfae04fe1346a77a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e936ec7350ca4c5cb73bbc88f1677829" is_pre_election: true
I20260811 06:54:28.769310 11963 raft_consensus.cc:2454] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7f89fb53d6249cfae04fe1346a77a15 in term 0.
I20260811 06:54:28.769677 11731 raft_consensus.cc:2454] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7f89fb53d6249cfae04fe1346a77a15 in term 0.
I20260811 06:54:28.770022 11384 leader_election.cc:302] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7f89fb53d6249cfae04fe1346a77a15, ffa78dbb57f04b7a9d8f19532dca6f8f; no voters:
I20260811 06:54:28.770428 12086 raft_consensus.cc:2781] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:54:28.770605 12086 raft_consensus.cc:482] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:54:28.770706 12086 raft_consensus.cc:3037] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:28.772962 12086 raft_consensus.cc:504] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 } } peers { permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 } } peers { permanent_uuid: "c7f89fb53d6249cfae04fe1346a77a15" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36669 } }
I20260811 06:54:28.773595 12086 leader_election.cc:288] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [CANDIDATE]: Term 1 election: Requested vote from peers ffa78dbb57f04b7a9d8f19532dca6f8f (127.12.145.3:46717), e936ec7350ca4c5cb73bbc88f1677829 (127.12.145.2:45307)
I20260811 06:54:28.774083 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "687faaf4192f459c95c0e15fa1d5e99d" candidate_uuid: "c7f89fb53d6249cfae04fe1346a77a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f"
I20260811 06:54:28.774089 11731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "687faaf4192f459c95c0e15fa1d5e99d" candidate_uuid: "c7f89fb53d6249cfae04fe1346a77a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e936ec7350ca4c5cb73bbc88f1677829"
I20260811 06:54:28.774266 11731 raft_consensus.cc:3037] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:28.774279 11963 raft_consensus.cc:3037] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:28.776485 11963 raft_consensus.cc:2454] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7f89fb53d6249cfae04fe1346a77a15 in term 1.
I20260811 06:54:28.776486 11731 raft_consensus.cc:2454] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7f89fb53d6249cfae04fe1346a77a15 in term 1.
I20260811 06:54:28.776875 11384 leader_election.cc:302] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7f89fb53d6249cfae04fe1346a77a15, ffa78dbb57f04b7a9d8f19532dca6f8f; no voters:
I20260811 06:54:28.777169 12086 raft_consensus.cc:2781] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:28.777644 12086 raft_consensus.cc:686] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 1 LEADER]: Becoming Leader. State: Replica: c7f89fb53d6249cfae04fe1346a77a15, State: Running, Role: LEADER
I20260811 06:54:28.778345 12086 consensus_queue.cc:237] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 } } peers { permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 } } peers { permanent_uuid: "c7f89fb53d6249cfae04fe1346a77a15" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36669 } }
I20260811 06:54:28.783357 11249 catalog_manager.cc:5495] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7f89fb53d6249cfae04fe1346a77a15 (127.12.145.1). New cstate: current_term: 1 leader_uuid: "c7f89fb53d6249cfae04fe1346a77a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7f89fb53d6249cfae04fe1346a77a15" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36669 } health_report { overall_health: HEALTHY } } }
I20260811 06:54:28.865618 12065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.860629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45458 (local address 127.12.145.1:36669)
0811 06:54:28.860829 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:28.860834 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:28.860854 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:54:28.860941 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:28.860945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:28.861041 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:28.861171 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:54:28.861499 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.862273 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.863663 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.864059 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.864144 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.864596 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:54:28.865089 (+ 493us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:54:28.865213 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:28.865287 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 06:54:28.865326 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:54:28.874002 11731 raft_consensus.cc:1261] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829 [term 1 FOLLOWER]: Refusing update from remote peer c7f89fb53d6249cfae04fe1346a77a15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:28.874101 11963 raft_consensus.cc:1261] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f [term 1 FOLLOWER]: Refusing update from remote peer c7f89fb53d6249cfae04fe1346a77a15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:28.874991 12090 consensus_queue.cc:1035] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e936ec7350ca4c5cb73bbc88f1677829" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 45307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:28.875409 12086 consensus_queue.cc:1035] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffa78dbb57f04b7a9d8f19532dca6f8f" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:28.907327 11246 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:28.907605 11246 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:28.911465 11246 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3059bde0a14f40f4bd3e07f3f23b1a6d: Sending DeleteTablet for 3 replicas of tablet 687faaf4192f459c95c0e15fa1d5e99d
I20260811 06:54:28.912818 11458 tablet_service.cc:1514] Processing DeleteTablet for tablet 687faaf4192f459c95c0e15fa1d5e99d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:28 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:45448
I20260811 06:54:28.912843 11696 tablet_service.cc:1514] Processing DeleteTablet for tablet 687faaf4192f459c95c0e15fa1d5e99d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:28 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:34148
I20260811 06:54:28.913760 12105 tablet_replica.cc:330] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: stopping tablet replica
I20260811 06:54:28.914513 12106 tablet_replica.cc:330] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: stopping tablet replica
I20260811 06:54:28.914484 12105 raft_consensus.cc:2229] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:28.914827 11924 tablet_service.cc:1514] Processing DeleteTablet for tablet 687faaf4192f459c95c0e15fa1d5e99d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:28 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:54718
I20260811 06:54:28.915006 12106 raft_consensus.cc:2229] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:54:28.915287 12105 raft_consensus.cc:2258] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:28.915861 12106 raft_consensus.cc:2258] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:28.916443 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 11352
I20260811 06:54:28.917850 12105 ts_tablet_manager.cc:1905] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:28.918064 12106 ts_tablet_manager.cc:1905] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:28.924916 12105 ts_tablet_manager.cc:1918] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:28.925194 12105 log.cc:1196] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/687faaf4192f459c95c0e15fa1d5e99d
I20260811 06:54:28.925457 12106 ts_tablet_manager.cc:1918] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:28.925662 12106 log.cc:1196] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/687faaf4192f459c95c0e15fa1d5e99d
I20260811 06:54:28.926028 12105 ts_tablet_manager.cc:1939] T 687faaf4192f459c95c0e15fa1d5e99d P e936ec7350ca4c5cb73bbc88f1677829: Deleting consensus metadata
I20260811 06:54:28.926204 12106 ts_tablet_manager.cc:1939] T 687faaf4192f459c95c0e15fa1d5e99d P c7f89fb53d6249cfae04fe1346a77a15: Deleting consensus metadata
I20260811 06:54:28.928056 11224 catalog_manager.cc:4841] TS e936ec7350ca4c5cb73bbc88f1677829 (127.12.145.2:45307): tablet 687faaf4192f459c95c0e15fa1d5e99d (table test-table [id=6c559685c8de4f619e2b2a3e682e3e13]) successfully deleted
I20260811 06:54:28.928381 11228 catalog_manager.cc:4841] TS c7f89fb53d6249cfae04fe1346a77a15 (127.12.145.1:36669): tablet 687faaf4192f459c95c0e15fa1d5e99d (table test-table [id=6c559685c8de4f619e2b2a3e682e3e13]) successfully deleted
I20260811 06:54:28.930804 12107 tablet_replica.cc:330] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: stopping tablet replica
I20260811 06:54:28.931285 12107 raft_consensus.cc:2229] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:28.931838 12107 raft_consensus.cc:2258] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:28.934098 12107 ts_tablet_manager.cc:1905] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 06:54:28 dist-test-slave-7lbf krb5kdc[11179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:54:28.941222 12107 ts_tablet_manager.cc:1918] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:28.941399 12107 log.cc:1196] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/687faaf4192f459c95c0e15fa1d5e99d
I20260811 06:54:28.941998 12107 ts_tablet_manager.cc:1939] T 687faaf4192f459c95c0e15fa1d5e99d P ffa78dbb57f04b7a9d8f19532dca6f8f: Deleting consensus metadata
I20260811 06:54:28.943996 11224 catalog_manager.cc:4841] TS ffa78dbb57f04b7a9d8f19532dca6f8f (127.12.145.3:46717): tablet 687faaf4192f459c95c0e15fa1d5e99d (table test-table [id=6c559685c8de4f619e2b2a3e682e3e13]) successfully deleted
I20260811 06:54:28.945355 12065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:28.917964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45472 (local address 127.12.145.1:36669)
0811 06:54:28.918158 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:28.918164 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:28.930095 (+ 11931us) server_negotiation.cc:407] Connection header received
0811 06:54:28.930279 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:28.930286 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:28.930385 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:28.930499 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:28.932011 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.932886 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.934231 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:28.934818 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:28.935142 (+ 324us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:28.939266 (+ 4124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:28.939279 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:28.939294 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:28.939327 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:28.942504 (+ 3177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:28.943217 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:28.943225 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:28.943227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:28.943384 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:28.943758 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:28.943762 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:28.943764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:28.944121 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:28.944479 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:28.944776 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 06:54:28.945021 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 06:54:28.946089 11567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:29.044270 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 11352
I20260811 06:54:29.071775 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 11586
Aug 11 06:54:29 dist-test-slave-7lbf krb5kdc[11179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:54:29.086449 12068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:29.072514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34154 (local address 127.12.145.2:45307)
0811 06:54:29.072671 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:29.072676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:29.072694 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:54:29.072854 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:29.072858 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:29.072920 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:29.073006 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:29.074344 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:29.075071 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:29.076344 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:29.076735 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:29.076824 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:29.080980 (+ 4156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:29.080997 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:29.081013 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:29.081050 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:29.083599 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:29.084343 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:29.084350 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:29.084353 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:29.084505 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:29.084862 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:29.084866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:29.084868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:29.085260 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:29.085586 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:29.085893 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 06:54:29.086110 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 06:54:29.087133 11800 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:29.175413 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 11586
I20260811 06:54:29.200316 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 11820
Aug 11 06:54:29 dist-test-slave-7lbf krb5kdc[11179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:54:29.216284 12060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:29.201130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54722 (local address 127.12.145.3:46717)
0811 06:54:29.201323 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:29.201329 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:29.201350 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:54:29.201549 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:29.201555 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:29.201641 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:29.201731 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:29.203173 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:29.204056 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:29.205323 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:29.205928 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:29.206051 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:29.210715 (+ 4664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:29.210731 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:29.210749 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:29.210785 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:29.213561 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:29.214226 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:29.214234 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:29.214236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:29.214375 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:29.214742 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:29.214746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:29.214748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:29.215105 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:29.215398 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:29.215720 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 06:54:29.215944 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:54:29.216962 12032 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:29.305694 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 11820
I20260811 06:54:29.328899 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 11195
I20260811 06:54:29.330021 11308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:29.440222 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 11195
2026-08-11T06:54:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4639 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T06:54:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:29Z Disabled control of system clock
I20260811 06:54:29.537091 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35471
--webserver_interface=127.12.145.62
--webserver_port=0
--builtin_ntp_servers=127.12.145.20:42743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:35471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 06:54:29.882887 12121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:29.883208 12121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:29.883311 12121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:29.890671 12121 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:29.890802 12121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:29.890863 12121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:29.890949 12121 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:29.891003 12121 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:29.900736 12121 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:35471
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:29.902093 12121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:29.903894 12121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:29.915294 12129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:29.915416 12131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:29.915409 12128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:29.916565 12121 server_base.cc:1034] running on GCE node
I20260811 06:54:29.917286 12121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:29.918715 12121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:29.919915 12121 hybrid_clock.cc:648] HybridClock initialized: now 1786431269919870 us; error 36 us; skew 500 ppm
I20260811 06:54:29.920234 12121 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:29.922402 12121 webserver.cc:460] Webserver started at http://127.12.145.62:37629/ using document root <none> and password file <none>
I20260811 06:54:29.923033 12121 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:29.923118 12121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:29.923395 12121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:29.926232 12121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b"
format_stamp: "Formatted at 2026-08-11 06:54:29 on dist-test-slave-7lbf"
server_key: "d02ce9ce4692e91a0ccb6531f4ed0ce0"
server_key_iv: "d96a258c2a0d070f82e9512e3286aed0"
server_key_version: "encryptionkey@0"
I20260811 06:54:29.926988 12121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b"
format_stamp: "Formatted at 2026-08-11 06:54:29 on dist-test-slave-7lbf"
server_key: "d02ce9ce4692e91a0ccb6531f4ed0ce0"
server_key_iv: "d96a258c2a0d070f82e9512e3286aed0"
server_key_version: "encryptionkey@0"
I20260811 06:54:29.931919 12121 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260811 06:54:29.935201 12140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:29.936466 12121 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:54:29.936625 12121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b"
format_stamp: "Formatted at 2026-08-11 06:54:29 on dist-test-slave-7lbf"
server_key: "d02ce9ce4692e91a0ccb6531f4ed0ce0"
server_key_iv: "d96a258c2a0d070f82e9512e3286aed0"
server_key_version: "encryptionkey@0"
I20260811 06:54:29.936812 12121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:29.952522 12121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:29.953440 12121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:29.953778 12121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:29.971527 12121 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:35471
I20260811 06:54:29.971549 12226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:35471 every 8 connection(s)
I20260811 06:54:29.972985 12121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:29.976761 12229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:29.977615 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 12121
I20260811 06:54:29.977821 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:29.978411 12868 external_mini_cluster.cc:1428] Setting key fa06c3e46cb8c33026e14f1bdec726ca
I20260811 06:54:29.990760 12229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b: Bootstrap starting.
I20260811 06:54:29.992940 12236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:29.980508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49202 (local address 127.12.145.62:35471)
0811 06:54:29.981610 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:29.981622 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:29.981672 (+ 50us) server_negotiation.cc:407] Connection header received
0811 06:54:29.983405 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:29.983429 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:29.983936 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:29.984294 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:29.984931 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:29.986303 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:29.988230 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:29.989005 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:29.989205 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:29.990464 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:29.990473 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:29.990487 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:29.991124 (+ 637us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:29.991211 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:29.991238 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:29.991337 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:29.991564 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 06:54:29.991924 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":411,"threads_started":1}
I20260811 06:54:29.994122 12229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:29.995463 12229 log.cc:824] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:29.998175 12229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b: No bootstrap required, opened a new log
I20260811 06:54:30.005280 12229 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35471 } }
I20260811 06:54:30.005709 12229 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:30.005810 12229 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4469fb2d42214a7ab5fb9c71a8eedd7b, State: Initialized, Role: FOLLOWER
I20260811 06:54:30.006352 12229 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35471 } }
I20260811 06:54:30.006575 12229 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:30.006680 12229 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:30.006808 12229 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:30.009227 12229 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35471 } }
I20260811 06:54:30.009716 12229 leader_election.cc:302] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4469fb2d42214a7ab5fb9c71a8eedd7b; no voters:
I20260811 06:54:30.010264 12229 leader_election.cc:288] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:30.010398 12238 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:30.011068 12238 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [term 1 LEADER]: Becoming Leader. State: Replica: 4469fb2d42214a7ab5fb9c71a8eedd7b, State: Running, Role: LEADER
I20260811 06:54:30.011620 12238 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35471 } }
I20260811 06:54:30.012449 12229 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:30.014449 12240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4469fb2d42214a7ab5fb9c71a8eedd7b. Latest consensus state: current_term: 1 leader_uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35471 } } }
I20260811 06:54:30.014850 12240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:30.014673 12239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4469fb2d42214a7ab5fb9c71a8eedd7b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35471 } } }
I20260811 06:54:30.015012 12239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:30.018473 12249 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:30.024394 12249 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:30.033977 12249 catalog_manager.cc:1347] Generated new cluster ID: c1971ad0fe08437b9afe16d1b42922fd
I20260811 06:54:30.034096 12249 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:30.047410 12249 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:30.049211 12249 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:30.056820 12249 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b: Generated new TSK 0
I20260811 06:54:30.057843 12249 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:30.063472 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35471
--builtin_ntp_servers=127.12.145.20:42743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 06:54:30.431704 12272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:30.432027 12272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:30.432173 12272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:30.439693 12272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:30.439813 12272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:30.440013 12272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:54:30.449625 12272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:30.450991 12272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:30.452890 12272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:30.466313 12283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:30.466266 12286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:30.466359 12284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:30.470824 12272 server_base.cc:1034] running on GCE node
I20260811 06:54:30.471460 12272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:30.472406 12272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:30.473608 12272 hybrid_clock.cc:648] HybridClock initialized: now 1786431270473549 us; error 45 us; skew 500 ppm
I20260811 06:54:30.473944 12272 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:30.476292 12272 webserver.cc:460] Webserver started at http://127.12.145.1:40311/ using document root <none> and password file <none>
I20260811 06:54:30.476990 12272 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:30.477095 12272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:30.477403 12272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:30.480496 12272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "49e469ffcd9b4b5d910f7fa0a223d92f"
format_stamp: "Formatted at 2026-08-11 06:54:30 on dist-test-slave-7lbf"
server_key: "d8394354d4994f8b57ee0bffc6b071f8"
server_key_iv: "81ec8e1d4e7ac071789cf35db93cd113"
server_key_version: "encryptionkey@0"
I20260811 06:54:30.481305 12272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "49e469ffcd9b4b5d910f7fa0a223d92f"
format_stamp: "Formatted at 2026-08-11 06:54:30 on dist-test-slave-7lbf"
server_key: "d8394354d4994f8b57ee0bffc6b071f8"
server_key_iv: "81ec8e1d4e7ac071789cf35db93cd113"
server_key_version: "encryptionkey@0"
I20260811 06:54:30.486689 12272 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 06:54:30.490301 12293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:30.491693 12272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:54:30.491863 12272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "49e469ffcd9b4b5d910f7fa0a223d92f"
format_stamp: "Formatted at 2026-08-11 06:54:30 on dist-test-slave-7lbf"
server_key: "d8394354d4994f8b57ee0bffc6b071f8"
server_key_iv: "81ec8e1d4e7ac071789cf35db93cd113"
server_key_version: "encryptionkey@0"
I20260811 06:54:30.492091 12272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:30.506160 12272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:30.506979 12272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:30.507265 12272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:30.508266 12272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:30.509799 12272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:30.509897 12272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:30.510004 12272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:30.510073 12272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:30.540467 12272 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:36983
I20260811 06:54:30.540517 12480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:36983 every 8 connection(s)
I20260811 06:54:30.541810 12272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:54:30.550657 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 12272
I20260811 06:54:30.550822 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:54:30.551258 12868 external_mini_cluster.cc:1428] Setting key f213697efeb365a17dc421d5ec9a5bd2
I20260811 06:54:30.554486 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35471
--builtin_ntp_servers=127.12.145.20:42743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 06:54:30.554581 12483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:30.544328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:35635 (local address 127.12.145.62:35471)
0811 06:54:30.544771 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:30.544776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:30.545847 (+ 1071us) server_negotiation.cc:407] Connection header received
0811 06:54:30.547636 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:30.547642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:30.547732 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:30.547833 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:30.548940 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:30.549717 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:30.551408 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:30.552003 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:30.552144 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:30.553678 (+ 1534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:30.553685 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:30.553689 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:30.553709 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:30.553768 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:30.553785 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:30.553947 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:30.554141 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 06:54:30.554240 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":237,"threads_started":1}
I20260811 06:54:30.555598 12484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:30.544787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35471 (local address 127.12.145.1:35635)
0811 06:54:30.545690 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:30.545727 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:30.547360 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:30.548089 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:30.548098 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:30.548184 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:30.548761 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:30.548779 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:30.549881 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:30.549885 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:30.551241 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:30.551256 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:30.552221 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:30.552227 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:30.552492 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:30.553259 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:54:30.553262 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:30.553317 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:54:30.553432 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:30.553943 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:30.553951 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:30.553956 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 06:54:30.554104 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 06:54:30.554408 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":260,"threads_started":1}
I20260811 06:54:30.557184 12481 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35471
I20260811 06:54:30.557473 12481 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:30.558240 12481 heartbeater.cc:511] Master 127.12.145.62:35471 requested a full tablet report, sending...
I20260811 06:54:30.560406 12167 ts_manager.cc:194] Registered new tserver with Master: 49e469ffcd9b4b5d910f7fa0a223d92f (127.12.145.1:36983)
I20260811 06:54:30.562275 12167 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.1:35635
W20260811 06:54:30.892091 12486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:30.892418 12486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:30.892561 12486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:30.900540 12486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:30.900688 12486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:30.900861 12486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:54:30.910346 12486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:30.911729 12486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:30.913733 12486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:30.927076 12493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:30.927008 12496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:30.927145 12494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:30.928171 12486 server_base.cc:1034] running on GCE node
I20260811 06:54:30.928812 12486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:30.929800 12486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:30.931012 12486 hybrid_clock.cc:648] HybridClock initialized: now 1786431270930959 us; error 48 us; skew 500 ppm
I20260811 06:54:30.931325 12486 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:30.933735 12486 webserver.cc:460] Webserver started at http://127.12.145.2:44271/ using document root <none> and password file <none>
I20260811 06:54:30.934499 12486 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:30.934608 12486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:30.934919 12486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:30.937873 12486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "95da78d0c1304382bce84661cf98827a"
format_stamp: "Formatted at 2026-08-11 06:54:30 on dist-test-slave-7lbf"
server_key: "a38ba1cfb834ffb23a5e8bc9a90afa41"
server_key_iv: "16e5a71eb3408ffeabe54fad18ad2355"
server_key_version: "encryptionkey@0"
I20260811 06:54:30.938673 12486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "95da78d0c1304382bce84661cf98827a"
format_stamp: "Formatted at 2026-08-11 06:54:30 on dist-test-slave-7lbf"
server_key: "a38ba1cfb834ffb23a5e8bc9a90afa41"
server_key_iv: "16e5a71eb3408ffeabe54fad18ad2355"
server_key_version: "encryptionkey@0"
I20260811 06:54:30.943959 12486 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 06:54:30.947530 12508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:30.948920 12486 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:54:30.949106 12486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "95da78d0c1304382bce84661cf98827a"
format_stamp: "Formatted at 2026-08-11 06:54:30 on dist-test-slave-7lbf"
server_key: "a38ba1cfb834ffb23a5e8bc9a90afa41"
server_key_iv: "16e5a71eb3408ffeabe54fad18ad2355"
server_key_version: "encryptionkey@0"
I20260811 06:54:30.949322 12486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:30.976639 12486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:30.977571 12486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:30.977917 12486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:30.979015 12486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:30.980638 12486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:30.980751 12486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:30.980876 12486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:30.980960 12486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:31.013585 12486 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:38263
I20260811 06:54:31.013662 12701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:38263 every 8 connection(s)
I20260811 06:54:31.015003 12486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:54:31.015695 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 12486
I20260811 06:54:31.015865 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:54:31.016556 12868 external_mini_cluster.cc:1428] Setting key 89a18be5921ed5981074a1e38320d06b
I20260811 06:54:31.020020 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35471
--builtin_ntp_servers=127.12.145.20:42743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 06:54:31.029719 12483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.018009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:60725 (local address 127.12.145.62:35471)
0811 06:54:31.018174 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:31.018179 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:31.020286 (+ 2107us) server_negotiation.cc:407] Connection header received
0811 06:54:31.022611 (+ 2325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:31.022616 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:31.022684 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:31.022774 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:31.024168 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.024873 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.026979 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.027371 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.027467 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.028995 (+ 1528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:31.029001 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:31.029004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:31.029024 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:31.029059 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:31.029070 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:31.029138 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:31.029362 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 06:54:31.029442 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 06:54:31.031106 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.018808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35471 (local address 127.12.145.2:60725)
0811 06:54:31.019967 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:31.020030 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:31.022290 (+ 2260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:31.023026 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:31.023037 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:31.023162 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:31.023988 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.024012 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.025029 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.025034 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.026824 (+ 1790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.026840 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.027601 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.027607 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.027884 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.028634 (+ 750us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:54:31.028638 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:31.028690 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:54:31.028795 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:31.029158 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:31.029167 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:31.029175 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 06:54:31.029355 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 06:54:31.029788 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":301,"threads_started":1}
I20260811 06:54:31.032536 12703 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35471
I20260811 06:54:31.032872 12703 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:31.033797 12703 heartbeater.cc:511] Master 127.12.145.62:35471 requested a full tablet report, sending...
I20260811 06:54:31.035244 12167 ts_manager.cc:194] Registered new tserver with Master: 95da78d0c1304382bce84661cf98827a (127.12.145.2:38263)
I20260811 06:54:31.036067 12167 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.2:60725
W20260811 06:54:31.355881 12709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:31.356148 12709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:31.356272 12709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:31.363386 12709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:31.363483 12709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:31.363627 12709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:54:31.372624 12709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:31.373919 12709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:31.375672 12709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:31.388633 12721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:31.388599 12716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:31.388684 12717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:31.393981 12709 server_base.cc:1034] running on GCE node
I20260811 06:54:31.394640 12709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:31.395725 12709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:31.396929 12709 hybrid_clock.cc:648] HybridClock initialized: now 1786431271396871 us; error 56 us; skew 500 ppm
I20260811 06:54:31.397248 12709 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:31.399578 12709 webserver.cc:460] Webserver started at http://127.12.145.3:36679/ using document root <none> and password file <none>
I20260811 06:54:31.400262 12709 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:31.400367 12709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:31.400701 12709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:31.403692 12709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "f4f1405f98554913b349008597bc9828"
format_stamp: "Formatted at 2026-08-11 06:54:31 on dist-test-slave-7lbf"
server_key: "3a9a8509dccb4f88968bd82e09bd448b"
server_key_iv: "455f2b728a49555c290af8d48a8e87a9"
server_key_version: "encryptionkey@0"
I20260811 06:54:31.404459 12709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "f4f1405f98554913b349008597bc9828"
format_stamp: "Formatted at 2026-08-11 06:54:31 on dist-test-slave-7lbf"
server_key: "3a9a8509dccb4f88968bd82e09bd448b"
server_key_iv: "455f2b728a49555c290af8d48a8e87a9"
server_key_version: "encryptionkey@0"
I20260811 06:54:31.409605 12709 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:54:31.413136 12730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:31.414507 12709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 06:54:31.414664 12709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "f4f1405f98554913b349008597bc9828"
format_stamp: "Formatted at 2026-08-11 06:54:31 on dist-test-slave-7lbf"
server_key: "3a9a8509dccb4f88968bd82e09bd448b"
server_key_iv: "455f2b728a49555c290af8d48a8e87a9"
server_key_version: "encryptionkey@0"
I20260811 06:54:31.414872 12709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:31.429376 12709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:31.430279 12709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:31.430606 12709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:31.431568 12709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:31.432956 12709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:31.433066 12709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:31.433172 12709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:31.433244 12709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:31.464684 12709 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:42877
I20260811 06:54:31.464757 12936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:42877 every 8 connection(s)
I20260811 06:54:31.466023 12709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:54:31.471282 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 12709
I20260811 06:54:31.471481 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:54:31.472095 12868 external_mini_cluster.cc:1428] Setting key 10b0af23f6e165a2bca1f20423976ea1
I20260811 06:54:31.479378 12483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.468555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:41035 (local address 127.12.145.62:35471)
0811 06:54:31.468739 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:31.468744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:31.470167 (+ 1423us) server_negotiation.cc:407] Connection header received
0811 06:54:31.472543 (+ 2376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:31.472548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:31.472641 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:31.472760 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:31.474207 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.475262 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.476812 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.477201 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.477287 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.478704 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:31.478710 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:31.478713 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:31.478731 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:31.478763 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:31.478774 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:31.478842 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:31.479058 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 06:54:31.479138 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 06:54:31.480561 12942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.469029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35471 (local address 127.12.145.3:41035)
0811 06:54:31.470013 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:31.470052 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:31.472222 (+ 2170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:31.473048 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:31.473059 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:31.473164 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:31.474002 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.474032 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.475429 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.475433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.476696 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.476709 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.477370 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.477375 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.477675 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.478376 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:54:31.478379 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:31.478427 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:54:31.478518 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:31.478863 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:31.478872 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:31.478879 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 06:54:31.479045 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 06:54:31.479433 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":277,"threads_started":1}
I20260811 06:54:31.481834 12940 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35471
I20260811 06:54:31.482091 12940 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:31.482779 12940 heartbeater.cc:511] Master 127.12.145.62:35471 requested a full tablet report, sending...
I20260811 06:54:31.484061 12167 ts_manager.cc:194] Registered new tserver with Master: f4f1405f98554913b349008597bc9828 (127.12.145.3:42877)
I20260811 06:54:31.484810 12167 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.3:41035
I20260811 06:54:31.487442 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:54:31.497215 12483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.491360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49216 (local address 127.12.145.62:35471)
0811 06:54:31.491551 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:31.491556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:31.491992 (+ 436us) server_negotiation.cc:407] Connection header received
0811 06:54:31.492160 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:31.492164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:31.492233 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:31.492315 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:31.492836 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.493548 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.494937 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.495428 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.495535 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.496546 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:31.496551 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:31.496555 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:31.496572 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:31.496606 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:31.496617 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:31.496735 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:31.496919 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 06:54:31.496963 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 06:54:31.500788 12167 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49216:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:54:31.507593 12167 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:54:31.541656 12965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.520029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53252 (local address 127.12.145.2:38263)
0811 06:54:31.532217 (+ 12188us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:31.532229 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:31.532267 (+ 38us) server_negotiation.cc:407] Connection header received
0811 06:54:31.532399 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:31.532408 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:31.532713 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:31.532954 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:31.534355 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.535468 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.538721 (+ 3253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.540353 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.540491 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.540760 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:31.541132 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 06:54:31.541314 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11974,"thread_start_us":14018,"threads_started":1}
I20260811 06:54:31.541688 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.519536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:38263 (local address 127.0.0.1:53252)
0811 06:54:31.530507 (+ 10971us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:31.530546 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:31.530718 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:31.533321 (+ 2603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:31.533330 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:31.533370 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:31.533906 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.533920 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.535620 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.535625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.538503 (+ 2878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.538521 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.540577 (+ 2056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.540587 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.540858 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.540912 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 06:54:31.541046 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 06:54:31.541225 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10803,"mutex_wait_us":258,"thread_start_us":10376,"threads_started":1}
I20260811 06:54:31.543795 12966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.520595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:42877 (local address 127.0.0.1:60688)
0811 06:54:31.536251 (+ 15656us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:31.536276 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:31.536418 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:31.537881 (+ 1463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:31.537885 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:31.537908 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:31.538265 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.538276 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.539701 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.539706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.541709 (+ 2003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.541724 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.543082 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.543090 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.543263 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.543297 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 06:54:31.543382 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 06:54:31.543503 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15494,"thread_start_us":15924,"threads_started":1}
I20260811 06:54:31.543813 12967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.520992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60688 (local address 127.12.145.3:42877)
0811 06:54:31.536857 (+ 15865us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:31.536865 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:31.536899 (+ 34us) server_negotiation.cc:407] Connection header received
0811 06:54:31.537008 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:31.537015 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:31.537232 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:31.537428 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:31.538466 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.539560 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.541931 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.542880 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.542982 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.543171 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:31.543433 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 06:54:31.543551 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15690,"thread_start_us":16667,"threads_started":1}
I20260811 06:54:31.548053 12961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.519146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:36983 (local address 127.0.0.1:60014)
0811 06:54:31.519813 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:31.519855 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:31.520042 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:31.535521 (+ 15479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:31.535526 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:31.535556 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:31.536350 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.536365 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.538321 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.538326 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.540437 (+ 2111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.540452 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.547218 (+ 6766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.547225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.547408 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.547440 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 06:54:31.547542 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 06:54:31.547679 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":24,"thread_start_us":802,"threads_started":1}
I20260811 06:54:31.548589 12963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.519321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60014 (local address 127.12.145.1:36983)
0811 06:54:31.534841 (+ 15520us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:31.534850 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:31.534886 (+ 36us) server_negotiation.cc:407] Connection header received
0811 06:54:31.535016 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:31.535025 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:31.535281 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:31.535525 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:31.536581 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.538178 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.545647 (+ 7469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.547021 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.547154 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.547437 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:31.547625 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 06:54:31.548214 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15335,"thread_start_us":15181,"threads_started":1}
I20260811 06:54:31.549737 12580 tablet_service.cc:1467] Processing CreateTablet for tablet 09105104c2fd478ab056970bb56a7a44 (DEFAULT_TABLE table=test-table [id=b6645e06dd2241f09994b566b14a70e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:31.551152 12580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09105104c2fd478ab056970bb56a7a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:31.551437 12817 tablet_service.cc:1467] Processing CreateTablet for tablet 09105104c2fd478ab056970bb56a7a44 (DEFAULT_TABLE table=test-table [id=b6645e06dd2241f09994b566b14a70e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:31.553122 12817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09105104c2fd478ab056970bb56a7a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:31.552687 12368 tablet_service.cc:1467] Processing CreateTablet for tablet 09105104c2fd478ab056970bb56a7a44 (DEFAULT_TABLE table=test-table [id=b6645e06dd2241f09994b566b14a70e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:31.554109 12368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09105104c2fd478ab056970bb56a7a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:31.563170 12969 tablet_bootstrap.cc:492] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: Bootstrap starting.
I20260811 06:54:31.565223 12481 heartbeater.cc:503] Master 127.12.145.62:35471 was elected leader, sending a full tablet report...
I20260811 06:54:31.567840 12970 tablet_bootstrap.cc:492] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: Bootstrap starting.
I20260811 06:54:31.568616 12969 tablet_bootstrap.cc:654] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:31.570034 12969 log.cc:824] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:31.571007 12971 tablet_bootstrap.cc:492] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f: Bootstrap starting.
I20260811 06:54:31.572150 12970 tablet_bootstrap.cc:654] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:31.573378 12970 log.cc:824] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:31.574290 12971 tablet_bootstrap.cc:654] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:31.574419 12969 tablet_bootstrap.cc:492] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: No bootstrap required, opened a new log
I20260811 06:54:31.574679 12969 ts_tablet_manager.cc:1397] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260811 06:54:31.575336 12971 log.cc:824] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:31.576634 12970 tablet_bootstrap.cc:492] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: No bootstrap required, opened a new log
I20260811 06:54:31.576905 12970 ts_tablet_manager.cc:1397] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 06:54:31.577867 12971 tablet_bootstrap.cc:492] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f: No bootstrap required, opened a new log
I20260811 06:54:31.578125 12971 ts_tablet_manager.cc:1397] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260811 06:54:31.585242 12969 raft_consensus.cc:348] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36983 } } peers { permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 } } peers { permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 } }
I20260811 06:54:31.585780 12969 raft_consensus.cc:374] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:31.585604 12971 raft_consensus.cc:348] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36983 } } peers { permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 } } peers { permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 } }
I20260811 06:54:31.585882 12969 raft_consensus.cc:729] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95da78d0c1304382bce84661cf98827a, State: Initialized, Role: FOLLOWER
I20260811 06:54:31.586016 12971 raft_consensus.cc:374] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:31.586123 12971 raft_consensus.cc:729] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49e469ffcd9b4b5d910f7fa0a223d92f, State: Initialized, Role: FOLLOWER
I20260811 06:54:31.586542 12969 consensus_queue.cc:260] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36983 } } peers { permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 } } peers { permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 } }
I20260811 06:54:31.586791 12971 consensus_queue.cc:260] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36983 } } peers { permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 } } peers { permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 } }
I20260811 06:54:31.587250 12970 raft_consensus.cc:348] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36983 } } peers { permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 } } peers { permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 } }
I20260811 06:54:31.587713 12970 raft_consensus.cc:374] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:31.587807 12970 raft_consensus.cc:729] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f1405f98554913b349008597bc9828, State: Initialized, Role: FOLLOWER
I20260811 06:54:31.588584 12970 consensus_queue.cc:260] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36983 } } peers { permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 } } peers { permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 } }
I20260811 06:54:31.589825 12703 heartbeater.cc:503] Master 127.12.145.62:35471 was elected leader, sending a full tablet report...
I20260811 06:54:31.590308 12971 ts_tablet_manager.cc:1428] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f: Time spent starting tablet: real 0.012s user 0.004s sys 0.008s
I20260811 06:54:31.590351 12940 heartbeater.cc:503] Master 127.12.145.62:35471 was elected leader, sending a full tablet report...
I20260811 06:54:31.591279 12969 ts_tablet_manager.cc:1428] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: Time spent starting tablet: real 0.016s user 0.015s sys 0.001s
I20260811 06:54:31.592458 12970 ts_tablet_manager.cc:1428] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260811 06:54:31.717689 12941 tablet.cc:2369] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:54:31.767644 12705 tablet.cc:2369] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:54:31.794486 12482 tablet.cc:2369] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:54:31.798530 12983 raft_consensus.cc:482] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:31.798887 12983 raft_consensus.cc:504] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36983 } } peers { permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 } } peers { permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 } }
I20260811 06:54:31.800697 12983 leader_election.cc:288] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95da78d0c1304382bce84661cf98827a (127.12.145.2:38263), f4f1405f98554913b349008597bc9828 (127.12.145.3:42877)
I20260811 06:54:31.807613 12967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.801132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:37431 (local address 127.12.145.3:42877)
0811 06:54:31.801328 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:31.801333 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:31.801925 (+ 592us) server_negotiation.cc:407] Connection header received
0811 06:54:31.802177 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:31.802182 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:31.802261 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:31.802379 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:31.803021 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.803834 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.805807 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.806686 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.806813 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.806864 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:31.807228 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 06:54:31.807372 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 06:54:31.807673 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.801059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:42877 (local address 127.12.145.1:37431)
0811 06:54:31.801805 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:31.801825 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:31.802017 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:31.802441 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:31.802444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:31.802472 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:31.802872 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.802888 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.803976 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.803983 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.805619 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.805633 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.806877 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.806885 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.807059 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.807094 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 06:54:31.807167 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 06:54:31.807278 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"mutex_wait_us":42,"thread_start_us":764,"threads_started":1}
I20260811 06:54:31.807658 12965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.801119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:56845 (local address 127.12.145.2:38263)
0811 06:54:31.801300 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:31.801306 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:31.802365 (+ 1059us) server_negotiation.cc:407] Connection header received
0811 06:54:31.802557 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:31.802563 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:31.802654 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:31.802752 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:31.803322 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.804049 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.806055 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.806833 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.806982 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.807049 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:31.807295 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 06:54:31.807422 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 06:54:31.807724 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.801561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:38263 (local address 127.12.145.1:56845)
0811 06:54:31.802261 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:31.802278 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:31.802402 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:31.802766 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:31.802769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:31.802792 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:31.803152 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.803165 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.804224 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.804229 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.805866 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:31.805882 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.807014 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.807019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:31.807132 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.807161 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 06:54:31.807251 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 06:54:31.807371 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"mutex_wait_us":42,"thread_start_us":464,"threads_started":1}
I20260811 06:54:31.808872 12620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09105104c2fd478ab056970bb56a7a44" candidate_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95da78d0c1304382bce84661cf98827a" is_pre_election: true
I20260811 06:54:31.808872 12854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09105104c2fd478ab056970bb56a7a44" candidate_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4f1405f98554913b349008597bc9828" is_pre_election: true
I20260811 06:54:31.809481 12620 raft_consensus.cc:2454] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49e469ffcd9b4b5d910f7fa0a223d92f in term 0.
I20260811 06:54:31.809481 12854 raft_consensus.cc:2454] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49e469ffcd9b4b5d910f7fa0a223d92f in term 0.
I20260811 06:54:31.810240 12300 leader_election.cc:302] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49e469ffcd9b4b5d910f7fa0a223d92f, 95da78d0c1304382bce84661cf98827a; no voters:
I20260811 06:54:31.810703 12983 raft_consensus.cc:2781] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:54:31.810840 12983 raft_consensus.cc:482] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:54:31.810966 12983 raft_consensus.cc:3037] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:31.813215 12983 raft_consensus.cc:504] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36983 } } peers { permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 } } peers { permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 } }
I20260811 06:54:31.813930 12983 leader_election.cc:288] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [CANDIDATE]: Term 1 election: Requested vote from peers 95da78d0c1304382bce84661cf98827a (127.12.145.2:38263), f4f1405f98554913b349008597bc9828 (127.12.145.3:42877)
I20260811 06:54:31.814481 12620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09105104c2fd478ab056970bb56a7a44" candidate_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95da78d0c1304382bce84661cf98827a"
I20260811 06:54:31.814481 12854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09105104c2fd478ab056970bb56a7a44" candidate_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4f1405f98554913b349008597bc9828"
I20260811 06:54:31.814702 12854 raft_consensus.cc:3037] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:31.814702 12620 raft_consensus.cc:3037] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:31.817932 12854 raft_consensus.cc:2454] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49e469ffcd9b4b5d910f7fa0a223d92f in term 1.
I20260811 06:54:31.817952 12620 raft_consensus.cc:2454] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49e469ffcd9b4b5d910f7fa0a223d92f in term 1.
I20260811 06:54:31.818403 12300 leader_election.cc:302] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49e469ffcd9b4b5d910f7fa0a223d92f, 95da78d0c1304382bce84661cf98827a; no voters:
I20260811 06:54:31.818681 12983 raft_consensus.cc:2781] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:31.819126 12983 raft_consensus.cc:686] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 1 LEADER]: Becoming Leader. State: Replica: 49e469ffcd9b4b5d910f7fa0a223d92f, State: Running, Role: LEADER
I20260811 06:54:31.819700 12983 consensus_queue.cc:237] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36983 } } peers { permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 } } peers { permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 } }
I20260811 06:54:31.824069 12164 catalog_manager.cc:5495] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f reported cstate change: term changed from 0 to 1, leader changed from <none> to 49e469ffcd9b4b5d910f7fa0a223d92f (127.12.145.1). New cstate: current_term: 1 leader_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e469ffcd9b4b5d910f7fa0a223d92f" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 36983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 } health_report { overall_health: UNKNOWN } } }
I20260811 06:54:31.855110 12963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.849543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60024 (local address 127.12.145.1:36983)
0811 06:54:31.849744 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:31.849750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:31.849791 (+ 41us) server_negotiation.cc:407] Connection header received
0811 06:54:31.850021 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:31.850026 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:31.850135 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:31.850258 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:54:31.850627 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.851325 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.852764 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.853164 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.853255 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.854003 (+ 748us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:54:31.854501 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:54:31.854631 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:31.854790 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 06:54:31.854828 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 06:54:31.863683 12620 raft_consensus.cc:1261] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a [term 1 FOLLOWER]: Refusing update from remote peer 49e469ffcd9b4b5d910f7fa0a223d92f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:31.863683 12854 raft_consensus.cc:1261] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828 [term 1 FOLLOWER]: Refusing update from remote peer 49e469ffcd9b4b5d910f7fa0a223d92f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:31.864799 12992 consensus_queue.cc:1035] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95da78d0c1304382bce84661cf98827a" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 38263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:31.865186 12983 consensus_queue.cc:1035] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4f1405f98554913b349008597bc9828" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 42877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:31.889775 12164 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:31.890085 12164 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:31.893959 12164 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4469fb2d42214a7ab5fb9c71a8eedd7b: Sending DeleteTablet for 3 replicas of tablet 09105104c2fd478ab056970bb56a7a44
I20260811 06:54:31.895164 12580 tablet_service.cc:1514] Processing DeleteTablet for tablet 09105104c2fd478ab056970bb56a7a44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:31 UTC) from {username='slave'} at 127.0.0.1:53252
I20260811 06:54:31.895144 12817 tablet_service.cc:1514] Processing DeleteTablet for tablet 09105104c2fd478ab056970bb56a7a44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:31 UTC) from {username='slave'} at 127.0.0.1:60688
I20260811 06:54:31.895558 12368 tablet_service.cc:1514] Processing DeleteTablet for tablet 09105104c2fd478ab056970bb56a7a44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:31 UTC) from {username='slave'} at 127.0.0.1:60014
I20260811 06:54:31.896579 13014 tablet_replica.cc:330] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f: stopping tablet replica
I20260811 06:54:31.897022 13014 raft_consensus.cc:2229] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:54:31.897171 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 12272
I20260811 06:54:31.897729 13014 raft_consensus.cc:2258] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:31.902997 13014 ts_tablet_manager.cc:1905] T 09105104c2fd478ab056970bb56a7a44 P 49e469ffcd9b4b5d910f7fa0a223d92f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:31.908944 12963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:31.900382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60038 (local address 127.12.145.1:36983)
0811 06:54:31.900600 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:31.900606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:31.900626 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:54:31.900685 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:31.900690 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:31.900797 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:31.900894 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:31.901577 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.902731 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.904728 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:31.905436 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:31.905600 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:31.907010 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:31.907021 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:31.907038 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:31.907930 (+ 892us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:31.908022 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:31.908053 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:31.908141 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:31.908399 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 06:54:31.908530 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 06:54:31.909921 12475 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:31.910415 13011 tablet_replica.cc:330] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: stopping tablet replica
I20260811 06:54:31.910702 13012 tablet_replica.cc:330] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: stopping tablet replica
I20260811 06:54:31.911113 13012 raft_consensus.cc:2229] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:31.911616 13012 raft_consensus.cc:2258] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:31.912334 13011 raft_consensus.cc:2229] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:31.912869 13011 raft_consensus.cc:2258] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:31.914008 13012 ts_tablet_manager.cc:1905] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:31.915109 13011 ts_tablet_manager.cc:1905] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:31.919799 13012 ts_tablet_manager.cc:1918] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:31.919963 13012 log.cc:1196] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/09105104c2fd478ab056970bb56a7a44
I20260811 06:54:31.920498 13012 ts_tablet_manager.cc:1939] T 09105104c2fd478ab056970bb56a7a44 P 95da78d0c1304382bce84661cf98827a: Deleting consensus metadata
I20260811 06:54:31.921408 13011 ts_tablet_manager.cc:1918] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:31.921566 13011 log.cc:1196] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/09105104c2fd478ab056970bb56a7a44
I20260811 06:54:31.921981 13011 ts_tablet_manager.cc:1939] T 09105104c2fd478ab056970bb56a7a44 P f4f1405f98554913b349008597bc9828: Deleting consensus metadata
I20260811 06:54:31.922483 12143 catalog_manager.cc:4841] TS 95da78d0c1304382bce84661cf98827a (127.12.145.2:38263): tablet 09105104c2fd478ab056970bb56a7a44 (table test-table [id=b6645e06dd2241f09994b566b14a70e5]) successfully deleted
I20260811 06:54:31.923538 12142 catalog_manager.cc:4841] TS f4f1405f98554913b349008597bc9828 (127.12.145.3:42877): tablet 09105104c2fd478ab056970bb56a7a44 (table test-table [id=b6645e06dd2241f09994b566b14a70e5]) successfully deleted
I20260811 06:54:32.008776 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 12272
W20260811 06:54:32.039525 12142 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.1:36983 (error 108)
I20260811 06:54:32.039590 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 12486
I20260811 06:54:32.041209 12961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:32.040734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:36983 (local address 127.0.0.1:60044)
0811 06:54:32.040904 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:32.041037 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 06:54:32.041458 12142 catalog_manager.cc:4584] TS 49e469ffcd9b4b5d910f7fa0a223d92f (127.12.145.1:36983): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 09105104c2fd478ab056970bb56a7a44: Network error: Client connection negotiation failed: client connection to 127.12.145.1:36983: connect: Connection refused (error 111)
I20260811 06:54:32.046631 12965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:32.040360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53260 (local address 127.12.145.2:38263)
0811 06:54:32.040528 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:32.040534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:32.040581 (+ 47us) server_negotiation.cc:407] Connection header received
0811 06:54:32.040768 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:32.040774 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:32.040910 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:32.040998 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:32.041499 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:32.042395 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:32.043660 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:32.044074 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:32.044182 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:32.045156 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:32.045165 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:32.045178 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:32.045921 (+ 743us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:32.045973 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:32.045993 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:32.046092 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:32.046224 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 06:54:32.046339 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:54:32.047271 12691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:32.095093 12961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:32.094613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:36983 (local address 127.0.0.1:60048)
0811 06:54:32.094840 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:32.094939 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 06:54:32.096107 12961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:32.095786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:36983 (local address 127.0.0.1:60064)
0811 06:54:32.095901 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:32.095973 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 06:54:32.135200 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 12486
I20260811 06:54:32.157116 12961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:32.156606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:36983 (local address 127.0.0.1:60076)
0811 06:54:32.156828 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:32.156921 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 06:54:32.158175 12961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:32.157797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:36983 (local address 127.0.0.1:60082)
0811 06:54:32.157982 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:32.158053 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 06:54:32.159430 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 12709
I20260811 06:54:32.166066 12967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:32.160191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60696 (local address 127.12.145.3:42877)
0811 06:54:32.160346 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:32.160351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:32.160398 (+ 47us) server_negotiation.cc:407] Connection header received
0811 06:54:32.160560 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:32.160564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:32.160655 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:32.160739 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:32.161239 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:32.162001 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:32.163297 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:32.163678 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:32.163766 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:32.164717 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:32.164727 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:32.164744 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:32.165329 (+ 585us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:32.165378 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:32.165399 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:32.165487 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:32.165706 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 06:54:32.165800 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 06:54:32.166786 12931 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:32.238725 12961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:32.238123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:36983 (local address 127.0.0.1:60092)
0811 06:54:32.238385 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:32.238506 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260811 06:54:32.239848 12961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:32.239426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:36983 (local address 127.0.0.1:60106)
0811 06:54:32.239648 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:32.239722 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:36983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260811 06:54:32.254062 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 12709
I20260811 06:54:32.279398 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 12121
I20260811 06:54:32.280578 12220 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:32.389739 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 12121
2026-08-11T06:54:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2945 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:32 dist-test-slave-7lbf krb5kdc[13029](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:32 dist-test-slave-7lbf krb5kdc[13029](info): set up 2 sockets
Aug 11 06:54:32 dist-test-slave-7lbf krb5kdc[13029](info): commencing operation
krb5kdc: starting...
W20260811 06:54:33.651511 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.007s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:33 dist-test-slave-7lbf krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:54:33.962314 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:41403
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:44175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:41403
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:34.300328 13054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:34.300609 13054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:34.300699 13054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:34.307753 13054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:34.307854 13054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:34.307909 13054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:34.307974 13054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:34.308017 13054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:34.318691 13054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:44175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:41403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:41403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:34.319974 13054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:34.321290 13054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:34.332764 13059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:34.332844 13060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:34.332849 13063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:34.334065 13054 server_base.cc:1034] running on GCE node
I20260811 06:54:34.334779 13054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:34.336211 13054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:34.337409 13054 hybrid_clock.cc:648] HybridClock initialized: now 1786431274337367 us; error 30 us; skew 500 ppm
I20260811 06:54:34.337772 13054 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:34 dist-test-slave-7lbf krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431274, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:34.344364 13054 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:54:34.345956 13054 webserver.cc:460] Webserver started at http://127.12.145.62:40051/ using document root <none> and password file <none>
I20260811 06:54:34.346643 13054 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:34.346765 13054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:34.347083 13054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:34.350121 13054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "04614f3a4a344a2baf1f83956e4bde9b"
format_stamp: "Formatted at 2026-08-11 06:54:34 on dist-test-slave-7lbf"
server_key: "72c63701019870e8b919ee0e22d290c8"
server_key_iv: "d4e39acba146774c291180caf24d567d"
server_key_version: "encryptionkey@0"
I20260811 06:54:34.350879 13054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "04614f3a4a344a2baf1f83956e4bde9b"
format_stamp: "Formatted at 2026-08-11 06:54:34 on dist-test-slave-7lbf"
server_key: "72c63701019870e8b919ee0e22d290c8"
server_key_iv: "d4e39acba146774c291180caf24d567d"
server_key_version: "encryptionkey@0"
I20260811 06:54:34.356033 13054 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:54:34.359473 13072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:34.360800 13054 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:54:34.360980 13054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "04614f3a4a344a2baf1f83956e4bde9b"
format_stamp: "Formatted at 2026-08-11 06:54:34 on dist-test-slave-7lbf"
server_key: "72c63701019870e8b919ee0e22d290c8"
server_key_iv: "d4e39acba146774c291180caf24d567d"
server_key_version: "encryptionkey@0"
I20260811 06:54:34.361169 13054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:34.394145 13054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:34.398313 13054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:34.398600 13054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:34.416682 13054 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:41403
I20260811 06:54:34.416689 13155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:41403 every 8 connection(s)
I20260811 06:54:34.418159 13054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:34.422222 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 13054
I20260811 06:54:34.422442 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:34.422610 13156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:34.423026 12868 external_mini_cluster.cc:1428] Setting key 58ec1d2b2bb25ac29333c42408f8bae2
I20260811 06:54:34.437597 13156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b: Bootstrap starting.
Aug 11 06:54:34 dist-test-slave-7lbf krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:34.441216 13156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:34.442389 13156 log.cc:824] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:34.445753 13156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b: No bootstrap required, opened a new log
I20260811 06:54:34.446864 13160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:34.424964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.12.145.62:41403)
0811 06:54:34.425816 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:34.425828 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:34.425874 (+ 46us) server_negotiation.cc:407] Connection header received
0811 06:54:34.427598 (+ 1724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:34.427621 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:34.428017 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:34.428370 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:34.430212 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:34.431644 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:34.433503 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:34.434290 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:34.434433 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:34.439598 (+ 5165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:34.439611 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:34.439626 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:34.439671 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:34.442719 (+ 3048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:34.443511 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:34.443520 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:34.443529 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:34.443732 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:34.444151 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:34.444155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:34.444157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:34.444678 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:34.444903 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:34.445390 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 06:54:34.445774 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":370,"threads_started":1}
I20260811 06:54:34.454041 13156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04614f3a4a344a2baf1f83956e4bde9b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41403 } }
I20260811 06:54:34.454450 13156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:34.454547 13156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04614f3a4a344a2baf1f83956e4bde9b, State: Initialized, Role: FOLLOWER
I20260811 06:54:34.455191 13156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04614f3a4a344a2baf1f83956e4bde9b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41403 } }
I20260811 06:54:34.455458 13156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:34.455592 13156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:34.455744 13156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:34.458022 13156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04614f3a4a344a2baf1f83956e4bde9b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41403 } }
I20260811 06:54:34.458529 13156 leader_election.cc:302] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04614f3a4a344a2baf1f83956e4bde9b; no voters:
I20260811 06:54:34.459101 13156 leader_election.cc:288] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:34.459225 13165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:34.459903 13165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [term 1 LEADER]: Becoming Leader. State: Replica: 04614f3a4a344a2baf1f83956e4bde9b, State: Running, Role: LEADER
I20260811 06:54:34.460440 13165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04614f3a4a344a2baf1f83956e4bde9b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41403 } }
I20260811 06:54:34.461243 13156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:34.463593 13168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "04614f3a4a344a2baf1f83956e4bde9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04614f3a4a344a2baf1f83956e4bde9b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41403 } } }
I20260811 06:54:34.464061 13168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:34.464884 13169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04614f3a4a344a2baf1f83956e4bde9b. Latest consensus state: current_term: 1 leader_uuid: "04614f3a4a344a2baf1f83956e4bde9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04614f3a4a344a2baf1f83956e4bde9b" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41403 } } }
I20260811 06:54:34.465867 13169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:34.466004 13179 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:34.471153 13179 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:34.480815 13179 catalog_manager.cc:1347] Generated new cluster ID: e6aca604dda14f5ebf3e750b418b66ab
I20260811 06:54:34.480960 13179 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:34.490182 13179 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:34.491477 13179 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:34.507592 13179 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b: Generated new TSK 0
I20260811 06:54:34.508778 13179 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
Entry for principal kudu/127.12.145.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab.
I20260811 06:54:34.591403 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:41403
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:44175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:34.936405 13202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:34.936700 13202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:34.936839 13202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:34.944068 13202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:34.944176 13202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:34.944339 13202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:54:34.954672 13202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:44175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.1.keytab
--principal=kudu/127.12.145.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:41403
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:34.956023 13202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:34.957419 13202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:34.970922 13212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:34.970952 13217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:34.971114 13213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:34.972429 13202 server_base.cc:1034] running on GCE node
I20260811 06:54:34.973033 13202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:34.974084 13202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:34.975308 13202 hybrid_clock.cc:648] HybridClock initialized: now 1786431274975237 us; error 55 us; skew 500 ppm
I20260811 06:54:34.975646 13202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:34 dist-test-slave-7lbf krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431274, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:34.978951 13202 init.cc:377] Logged in from keytab as kudu/127.12.145.1@KRBTEST.COM (short username kudu)
I20260811 06:54:34.980532 13202 webserver.cc:460] Webserver started at http://127.12.145.1:33445/ using document root <none> and password file <none>
I20260811 06:54:34.981310 13202 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:34.981444 13202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:34.981838 13202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:34.985005 13202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "fde8d0289f0c4e119b7d9d15c5fe2925"
format_stamp: "Formatted at 2026-08-11 06:54:34 on dist-test-slave-7lbf"
server_key: "3e6a75c5593c7d148de24d3e1f52980b"
server_key_iv: "85374af4270ec5da81c7513abaa1e3b9"
server_key_version: "encryptionkey@0"
I20260811 06:54:34.985888 13202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "fde8d0289f0c4e119b7d9d15c5fe2925"
format_stamp: "Formatted at 2026-08-11 06:54:34 on dist-test-slave-7lbf"
server_key: "3e6a75c5593c7d148de24d3e1f52980b"
server_key_iv: "85374af4270ec5da81c7513abaa1e3b9"
server_key_version: "encryptionkey@0"
I20260811 06:54:34.991379 13202 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:54:34.995106 13224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:34.996456 13202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:54:34.996623 13202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "fde8d0289f0c4e119b7d9d15c5fe2925"
format_stamp: "Formatted at 2026-08-11 06:54:34 on dist-test-slave-7lbf"
server_key: "3e6a75c5593c7d148de24d3e1f52980b"
server_key_iv: "85374af4270ec5da81c7513abaa1e3b9"
server_key_version: "encryptionkey@0"
I20260811 06:54:34.996845 13202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:35.017323 13202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:35.021289 13202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:35.021607 13202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:35.022612 13202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:35.024011 13202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:35.024091 13202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:35.024230 13202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:35.024284 13202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:35.055234 13202 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:41973
I20260811 06:54:35.055274 13404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:41973 every 8 connection(s)
I20260811 06:54:35.056495 13202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:54:35.064044 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 13202
I20260811 06:54:35.064268 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:54:35.064852 12868 external_mini_cluster.cc:1428] Setting key 14405fef7316573ea7c867143578b221
Aug 11 06:54:35 dist-test-slave-7lbf krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431274, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.1@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:35.077435 13410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:35.059093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:40859 (local address 127.12.145.62:41403)
0811 06:54:35.059584 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:35.059591 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:35.060499 (+ 908us) server_negotiation.cc:407] Connection header received
0811 06:54:35.062447 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:35.062452 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:35.062522 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:35.062619 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:35.064187 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:35.065282 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:35.067229 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:35.067953 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:35.068099 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:35.071762 (+ 3663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:35.071768 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:35.071771 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:35.071807 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:35.074288 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:35.075180 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:35.075184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:35.075186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:35.075299 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:35.075766 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:35.075768 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:35.075770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:35.076024 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:35.076129 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:35.076997 (+ 868us) server_negotiation.cc:299] Negotiation successful
0811 06:54:35.077163 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":223,"threads_started":1}
I20260811 06:54:35.078962 13411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:35.059622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:41403 (local address 127.12.145.1:40859)
0811 06:54:35.060326 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:35.060369 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:35.062193 (+ 1824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:35.062839 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:35.062847 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:35.063360 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:35.064005 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:35.064025 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:35.065480 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:35.065485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:35.067062 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:35.067076 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:35.068164 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:35.068169 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:35.068360 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:35.069030 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:35.069059 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:35.071525 (+ 2466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:35.074435 (+ 2910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:35.074445 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:35.074461 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:35.075072 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:35.075398 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:35.075403 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:35.075407 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:35.075667 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:35.076149 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:35.076157 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:35.076595 (+ 438us) client_negotiation.cc:769] Sending connection context
0811 06:54:35.076934 (+ 339us) client_negotiation.cc:240] Negotiation successful
0811 06:54:35.077467 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":259,"threads_started":1}
I20260811 06:54:35.080539 13405 heartbeater.cc:347] Connected to a master server at 127.12.145.62:41403
I20260811 06:54:35.080832 13405 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:35.081585 13405 heartbeater.cc:511] Master 127.12.145.62:41403 requested a full tablet report, sending...
I20260811 06:54:35.083774 13101 ts_manager.cc:194] Registered new tserver with Master: fde8d0289f0c4e119b7d9d15c5fe2925 (127.12.145.1:41973)
I20260811 06:54:35.085304 13101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.1@KRBTEST.COM'} at 127.12.145.1:40859
WARNING: no policy specified for kudu/127.12.145.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
Entry for principal kudu/127.12.145.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab.
I20260811 06:54:35.130880 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:41403
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:44175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:35.470687 13418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:35.470985 13418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:35.471125 13418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:35.478392 13418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:35.478514 13418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:35.478667 13418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:54:35.489024 13418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:44175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.2.keytab
--principal=kudu/127.12.145.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:41403
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:35.490398 13418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:35.491814 13418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:35.504522 13429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:35.504545 13431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:35.504583 13427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:35.505612 13418 server_base.cc:1034] running on GCE node
I20260811 06:54:35.506196 13418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:35.507055 13418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:35.508255 13418 hybrid_clock.cc:648] HybridClock initialized: now 1786431275508193 us; error 52 us; skew 500 ppm
I20260811 06:54:35.508544 13418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:35 dist-test-slave-7lbf krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431275, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:35.511439 13418 init.cc:377] Logged in from keytab as kudu/127.12.145.2@KRBTEST.COM (short username kudu)
I20260811 06:54:35.512835 13418 webserver.cc:460] Webserver started at http://127.12.145.2:41687/ using document root <none> and password file <none>
I20260811 06:54:35.513482 13418 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:35.513645 13418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:35.513957 13418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:35.516776 13418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "7101301231b84cbca942f8d6caec5bb8"
format_stamp: "Formatted at 2026-08-11 06:54:35 on dist-test-slave-7lbf"
server_key: "d41ff0c77ab8d5c3c81ff084ebbd87ed"
server_key_iv: "e8bb431948843781d20ddcb4961e49f9"
server_key_version: "encryptionkey@0"
I20260811 06:54:35.517504 13418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "7101301231b84cbca942f8d6caec5bb8"
format_stamp: "Formatted at 2026-08-11 06:54:35 on dist-test-slave-7lbf"
server_key: "d41ff0c77ab8d5c3c81ff084ebbd87ed"
server_key_iv: "e8bb431948843781d20ddcb4961e49f9"
server_key_version: "encryptionkey@0"
I20260811 06:54:35.522426 13418 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 06:54:35.525831 13440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:35.527141 13418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:54:35.527289 13418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "7101301231b84cbca942f8d6caec5bb8"
format_stamp: "Formatted at 2026-08-11 06:54:35 on dist-test-slave-7lbf"
server_key: "d41ff0c77ab8d5c3c81ff084ebbd87ed"
server_key_iv: "e8bb431948843781d20ddcb4961e49f9"
server_key_version: "encryptionkey@0"
I20260811 06:54:35.527470 13418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:35.547714 13418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:35.551656 13418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:35.551950 13418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:35.552915 13418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:35.554308 13418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:35.554394 13418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:35.554528 13418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:35.554584 13418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:35.585126 13418 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:39033
I20260811 06:54:35.585165 13633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:39033 every 8 connection(s)
I20260811 06:54:35.586462 13418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:54:35.589668 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 13418
I20260811 06:54:35.589847 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:54:35.590260 12868 external_mini_cluster.cc:1428] Setting key fe35daed5092ffe9e235daaec197adc7
Aug 11 06:54:35 dist-test-slave-7lbf krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431275, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.2@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:35.606840 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:35.588935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:46541 (local address 127.12.145.62:41403)
0811 06:54:35.589415 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:35.589422 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:35.590472 (+ 1050us) server_negotiation.cc:407] Connection header received
0811 06:54:35.592538 (+ 2066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:35.592545 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:35.592622 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:35.592736 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:35.594215 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:35.595189 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:35.596671 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:35.597220 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:35.597337 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:35.600650 (+ 3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:35.600657 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:35.600661 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:35.600702 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:35.603746 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:35.604466 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:35.604471 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:35.604475 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:35.604629 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:35.605019 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:35.605024 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:35.605026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:35.605353 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:35.605491 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:35.606241 (+ 750us) server_negotiation.cc:299] Negotiation successful
0811 06:54:35.606482 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":195,"threads_started":1}
I20260811 06:54:35.607657 13641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:35.589489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:41403 (local address 127.12.145.2:46541)
0811 06:54:35.590299 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:35.590353 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:35.592279 (+ 1926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:35.592916 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:35.592925 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:35.593432 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:35.594042 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:35.594063 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:35.595315 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:35.595319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:35.596528 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:35.596540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:35.597410 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:35.597414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:35.597667 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:35.598270 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:35.598298 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:35.600402 (+ 2104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:35.603887 (+ 3485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:35.603894 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:35.603908 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:35.604340 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:35.604724 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:35.604727 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:35.604730 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:35.604905 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:35.605458 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:35.605464 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:35.605841 (+ 377us) client_negotiation.cc:769] Sending connection context
0811 06:54:35.606088 (+ 247us) client_negotiation.cc:240] Negotiation successful
0811 06:54:35.606478 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":309,"threads_started":1}
I20260811 06:54:35.609114 13635 heartbeater.cc:347] Connected to a master server at 127.12.145.62:41403
I20260811 06:54:35.609422 13635 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:35.610180 13635 heartbeater.cc:511] Master 127.12.145.62:41403 requested a full tablet report, sending...
I20260811 06:54:35.611670 13101 ts_manager.cc:194] Registered new tserver with Master: 7101301231b84cbca942f8d6caec5bb8 (127.12.145.2:39033)
I20260811 06:54:35.612483 13101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.2@KRBTEST.COM'} at 127.12.145.2:46541
WARNING: no policy specified for kudu/127.12.145.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
Entry for principal kudu/127.12.145.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab.
I20260811 06:54:35.656519 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:41403
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:44175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:36.002368 13646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:36.002667 13646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:36.002807 13646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:36.009984 13646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:36.010118 13646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:36.010270 13646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:54:36.020277 13646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:44175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.3.keytab
--principal=kudu/127.12.145.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:41403
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:36.021610 13646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:36.022931 13646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:36.035857 13657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:36.035945 13655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:36.036372 13654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:36.037103 13646 server_base.cc:1034] running on GCE node
I20260811 06:54:36.037793 13646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:36.038749 13646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:36.039954 13646 hybrid_clock.cc:648] HybridClock initialized: now 1786431276039907 us; error 49 us; skew 500 ppm
I20260811 06:54:36.040273 13646 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:36 dist-test-slave-7lbf krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431276, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:36.043489 13646 init.cc:377] Logged in from keytab as kudu/127.12.145.3@KRBTEST.COM (short username kudu)
I20260811 06:54:36.044986 13646 webserver.cc:460] Webserver started at http://127.12.145.3:38181/ using document root <none> and password file <none>
I20260811 06:54:36.045765 13646 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:36.045894 13646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:36.046188 13646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:36.049293 13646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "5f29bf870fd64787bef834aa6f611bff"
format_stamp: "Formatted at 2026-08-11 06:54:36 on dist-test-slave-7lbf"
server_key: "7e436db26c251a51b99e624f03b0e6bb"
server_key_iv: "7c11f4b5b28a35bb040b5806fd2fbfcf"
server_key_version: "encryptionkey@0"
I20260811 06:54:36.050158 13646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "5f29bf870fd64787bef834aa6f611bff"
format_stamp: "Formatted at 2026-08-11 06:54:36 on dist-test-slave-7lbf"
server_key: "7e436db26c251a51b99e624f03b0e6bb"
server_key_iv: "7c11f4b5b28a35bb040b5806fd2fbfcf"
server_key_version: "encryptionkey@0"
I20260811 06:54:36.055786 13646 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:54:36.059581 13666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:36.060886 13646 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:54:36.061054 13646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "5f29bf870fd64787bef834aa6f611bff"
format_stamp: "Formatted at 2026-08-11 06:54:36 on dist-test-slave-7lbf"
server_key: "7e436db26c251a51b99e624f03b0e6bb"
server_key_iv: "7c11f4b5b28a35bb040b5806fd2fbfcf"
server_key_version: "encryptionkey@0"
I20260811 06:54:36.061245 13646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:36.072786 13646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:36.077143 13646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:36.077425 13646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:36.078408 13646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:36.079735 13646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:36.079833 13646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:36.079955 13646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:36.080009 13646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:36.088459 13405 heartbeater.cc:503] Master 127.12.145.62:41403 was elected leader, sending a full tablet report...
I20260811 06:54:36.110198 13646 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:39073
I20260811 06:54:36.110241 13851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:39073 every 8 connection(s)
I20260811 06:54:36.111522 13646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:54:36.116904 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 13646
I20260811 06:54:36.117085 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:54:36.117494 12868 external_mini_cluster.cc:1428] Setting key 54694798460f307b93b44865299acc91
Aug 11 06:54:36 dist-test-slave-7lbf krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431276, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.3@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:54:36.130808 13856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.114085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:45863 (local address 127.12.145.62:41403)
0811 06:54:36.114510 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.114515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.115462 (+ 947us) server_negotiation.cc:407] Connection header received
0811 06:54:36.117250 (+ 1788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.117256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.117344 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.117444 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:36.119189 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.120109 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.121632 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.122032 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.122126 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.125444 (+ 3318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:36.125449 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:36.125452 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:36.125486 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:36.127899 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:36.128571 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:36.128575 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:36.128578 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:36.128702 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:36.129148 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:36.129151 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:36.129153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:36.129405 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:36.129560 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.130220 (+ 660us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.130429 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":210,"threads_started":1}
I20260811 06:54:36.132009 13857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.114610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:41403 (local address 127.12.145.3:45863)
0811 06:54:36.115289 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.115342 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:36.116966 (+ 1624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:36.117727 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:36.117735 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:36.118368 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:36.119001 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.119027 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.120248 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.120252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.121482 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.121499 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.122200 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.122205 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.122419 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.123033 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:54:36.123056 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:36.125227 (+ 2171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:36.128019 (+ 2792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:36.128025 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:36.128038 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:36.128466 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:36.128835 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:54:36.128839 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:54:36.128842 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:54:36.129053 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:54:36.129567 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:36.129576 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:36.129897 (+ 321us) client_negotiation.cc:769] Sending connection context
0811 06:54:36.130126 (+ 229us) client_negotiation.cc:240] Negotiation successful
0811 06:54:36.130563 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":261,"threads_started":1}
I20260811 06:54:36.133252 13853 heartbeater.cc:347] Connected to a master server at 127.12.145.62:41403
I20260811 06:54:36.133594 13853 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:36.134287 13853 heartbeater.cc:511] Master 127.12.145.62:41403 requested a full tablet report, sending...
I20260811 06:54:36.135718 13101 ts_manager.cc:194] Registered new tserver with Master: 5f29bf870fd64787bef834aa6f611bff (127.12.145.3:39073)
I20260811 06:54:36.136494 13101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.3@KRBTEST.COM'} at 127.12.145.3:45863
I20260811 06:54:36.144716 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:54:36.160892 13856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.148721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34392 (local address 127.12.145.62:41403)
0811 06:54:36.148931 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.148938 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.149260 (+ 322us) server_negotiation.cc:407] Connection header received
0811 06:54:36.149399 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.149402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.149464 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.149587 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:36.151059 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.151774 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.153067 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.153446 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.153582 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.155881 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:36.155886 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:36.155889 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:36.155919 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:36.158418 (+ 2499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:36.159106 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:36.159109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:36.159112 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:36.159235 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:36.159560 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:36.159563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:36.159565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:36.159884 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:36.160088 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.160449 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.160622 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 06:54:36.164953 13101 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:54:36.172006 13101 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:54:36.196708 13876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.184771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56112 (local address 127.12.145.3:39073)
0811 06:54:36.185696 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.185708 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.186459 (+ 751us) server_negotiation.cc:407] Connection header received
0811 06:54:36.186915 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.186924 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.187188 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.187384 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:36.188536 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.190289 (+ 1753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.193216 (+ 2927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.194863 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.194983 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.195252 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.196049 (+ 797us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.196264 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":467,"threads_started":1}
I20260811 06:54:36.197923 13875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.184519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:39073 (local address 127.0.0.1:56112)
0811 06:54:36.186294 (+ 1775us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.186334 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:36.186630 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:36.187807 (+ 1177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:36.187815 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:36.187851 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:36.188276 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.188300 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.190511 (+ 2211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.190517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.192998 (+ 2481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.193016 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.195494 (+ 2478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.195501 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.195747 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.195803 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 06:54:36.197218 (+ 1415us) client_negotiation.cc:240] Negotiation successful
0811 06:54:36.197477 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1521,"thread_start_us":1366,"threads_started":1}
I20260811 06:54:36.204826 13743 tablet_service.cc:1467] Processing CreateTablet for tablet 4ddd609cf10443f781d5446cfb249e01 (DEFAULT_TABLE table=test-table [id=f6165e2e46864dcfbb8574d83e948675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:36.205614 13880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.185933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36044 (local address 127.12.145.2:39033)
0811 06:54:36.198272 (+ 12339us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.198282 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.198706 (+ 424us) server_negotiation.cc:407] Connection header received
0811 06:54:36.198842 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.198851 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.199142 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.199392 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:36.199735 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.201250 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.203376 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.204507 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.204636 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.204861 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.205109 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.205272 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12139,"thread_start_us":12341,"threads_started":1}
I20260811 06:54:36.205605 13875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.185453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:39033 (local address 127.0.0.1:36044)
0811 06:54:36.198392 (+ 12939us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.198415 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:36.198551 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:36.199388 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:36.199393 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:36.199420 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:36.199578 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.199589 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.201413 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.201419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.203238 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.203251 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.204677 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.204683 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.204932 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.204961 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 06:54:36.205046 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 06:54:36.205191 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12827,"mutex_wait_us":46,"thread_start_us":13182,"threads_started":1}
I20260811 06:54:36.206723 13743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ddd609cf10443f781d5446cfb249e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:36.209798 13517 tablet_service.cc:1467] Processing CreateTablet for tablet 4ddd609cf10443f781d5446cfb249e01 (DEFAULT_TABLE table=test-table [id=f6165e2e46864dcfbb8574d83e948675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:36.211148 13886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.187013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35592 (local address 127.12.145.1:41973)
0811 06:54:36.199643 (+ 12630us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.199652 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.199680 (+ 28us) server_negotiation.cc:407] Connection header received
0811 06:54:36.199770 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.199776 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.199973 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.200193 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:36.200829 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.202431 (+ 1602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.205595 (+ 3164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.209850 (+ 4255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.209982 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.210216 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.210425 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.210612 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12431,"thread_start_us":12422,"threads_started":1}
I20260811 06:54:36.211704 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.187296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41973 (local address 127.0.0.1:35592)
0811 06:54:36.198900 (+ 11604us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.198923 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:36.199062 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:36.200211 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:36.200216 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:36.200241 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:36.200633 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.200645 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.202591 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.202597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.205328 (+ 2731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.205346 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.210053 (+ 4707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.210060 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.210236 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.210270 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 06:54:36.210354 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 06:54:36.210493 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11478,"mutex_wait_us":1,"thread_start_us":11717,"threads_started":1}
I20260811 06:54:36.211973 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ddd609cf10443f781d5446cfb249e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:36.214737 13294 tablet_service.cc:1467] Processing CreateTablet for tablet 4ddd609cf10443f781d5446cfb249e01 (DEFAULT_TABLE table=test-table [id=f6165e2e46864dcfbb8574d83e948675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:36.216027 13294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ddd609cf10443f781d5446cfb249e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:36.223623 13889 tablet_bootstrap.cc:492] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: Bootstrap starting.
I20260811 06:54:36.226643 13892 tablet_bootstrap.cc:492] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: Bootstrap starting.
I20260811 06:54:36.227528 13889 tablet_bootstrap.cc:654] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:36.228438 13893 tablet_bootstrap.cc:492] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: Bootstrap starting.
I20260811 06:54:36.229485 13889 log.cc:824] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:36.230301 13892 tablet_bootstrap.cc:654] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:36.231626 13892 log.cc:824] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:36.233330 13893 tablet_bootstrap.cc:654] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:36.234604 13893 log.cc:824] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:36.234918 13892 tablet_bootstrap.cc:492] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: No bootstrap required, opened a new log
I20260811 06:54:36.235209 13889 tablet_bootstrap.cc:492] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: No bootstrap required, opened a new log
I20260811 06:54:36.235211 13892 ts_tablet_manager.cc:1397] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 06:54:36.235498 13889 ts_tablet_manager.cc:1397] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260811 06:54:36.237964 13893 tablet_bootstrap.cc:492] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: No bootstrap required, opened a new log
I20260811 06:54:36.238265 13893 ts_tablet_manager.cc:1397] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260811 06:54:36.243170 13889 raft_consensus.cc:348] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 } } peers { permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 } } peers { permanent_uuid: "7101301231b84cbca942f8d6caec5bb8" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 39033 } }
I20260811 06:54:36.243566 13889 raft_consensus.cc:374] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:36.243697 13889 raft_consensus.cc:729] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f29bf870fd64787bef834aa6f611bff, State: Initialized, Role: FOLLOWER
I20260811 06:54:36.244288 13889 consensus_queue.cc:260] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 } } peers { permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 } } peers { permanent_uuid: "7101301231b84cbca942f8d6caec5bb8" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 39033 } }
I20260811 06:54:36.245422 13853 heartbeater.cc:503] Master 127.12.145.62:41403 was elected leader, sending a full tablet report...
I20260811 06:54:36.245431 13892 raft_consensus.cc:348] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 } } peers { permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 } } peers { permanent_uuid: "7101301231b84cbca942f8d6caec5bb8" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 39033 } }
I20260811 06:54:36.245880 13892 raft_consensus.cc:374] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:36.245957 13889 ts_tablet_manager.cc:1428] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: Time spent starting tablet: real 0.010s user 0.004s sys 0.006s
I20260811 06:54:36.246065 13892 raft_consensus.cc:729] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7101301231b84cbca942f8d6caec5bb8, State: Initialized, Role: FOLLOWER
I20260811 06:54:36.246845 13892 consensus_queue.cc:260] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 } } peers { permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 } } peers { permanent_uuid: "7101301231b84cbca942f8d6caec5bb8" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 39033 } }
I20260811 06:54:36.247922 13635 heartbeater.cc:503] Master 127.12.145.62:41403 was elected leader, sending a full tablet report...
I20260811 06:54:36.248376 13892 ts_tablet_manager.cc:1428] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260811 06:54:36.250460 13893 raft_consensus.cc:348] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 } } peers { permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 } } peers { permanent_uuid: "7101301231b84cbca942f8d6caec5bb8" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 39033 } }
I20260811 06:54:36.250957 13893 raft_consensus.cc:374] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:36.251071 13893 raft_consensus.cc:729] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fde8d0289f0c4e119b7d9d15c5fe2925, State: Initialized, Role: FOLLOWER
I20260811 06:54:36.251636 13893 consensus_queue.cc:260] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 } } peers { permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 } } peers { permanent_uuid: "7101301231b84cbca942f8d6caec5bb8" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 39033 } }
I20260811 06:54:36.253226 13893 ts_tablet_manager.cc:1428] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: Time spent starting tablet: real 0.015s user 0.011s sys 0.001s
W20260811 06:54:36.308990 13407 tablet.cc:2369] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:54:36.338572 13636 tablet.cc:2369] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:54:36.363178 13855 tablet.cc:2369] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:54:36.383396 13900 raft_consensus.cc:482] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:36.383690 13900 raft_consensus.cc:504] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 } } peers { permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 } } peers { permanent_uuid: "7101301231b84cbca942f8d6caec5bb8" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 39033 } }
I20260811 06:54:36.385386 13900 leader_election.cc:288] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f29bf870fd64787bef834aa6f611bff (127.12.145.3:39073), fde8d0289f0c4e119b7d9d15c5fe2925 (127.12.145.1:41973)
I20260811 06:54:36.392479 13876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.385843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:33285 (local address 127.12.145.3:39073)
0811 06:54:36.386045 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.386054 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.386525 (+ 471us) server_negotiation.cc:407] Connection header received
0811 06:54:36.386723 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.386729 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.386828 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.386919 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:36.387629 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.388672 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.390821 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.391581 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.391729 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.391815 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.392092 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.392217 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:54:36.392635 13886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.386792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:44209 (local address 127.12.145.1:41973)
0811 06:54:36.387019 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.387024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.387221 (+ 197us) server_negotiation.cc:407] Connection header received
0811 06:54:36.387384 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.387390 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.387465 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.387557 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:36.388157 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.388904 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.390932 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.391732 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.391882 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.391955 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.392264 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.392394 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 06:54:36.392665 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.385768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:39073 (local address 127.12.145.2:33285)
0811 06:54:36.386400 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.386416 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:36.386575 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:36.387034 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:36.387039 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:36.387070 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:36.387428 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.387441 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.388804 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.388809 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.390653 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.390666 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.391785 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.391791 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.391939 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.391963 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 06:54:36.392052 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 06:54:36.392184 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":20,"thread_start_us":333,"threads_started":1}
I20260811 06:54:36.392769 13907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.386515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41973 (local address 127.12.145.2:44209)
0811 06:54:36.387130 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.387144 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:36.387255 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:36.387614 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:36.387619 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:36.387646 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:36.388019 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.388034 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.389040 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.389045 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.390764 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:36.390778 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.391953 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.391959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:36.392112 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.392135 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 06:54:36.392214 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 06:54:36.392336 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"mutex_wait_us":4,"thread_start_us":279,"threads_started":1}
I20260811 06:54:36.393749 13781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddd609cf10443f781d5446cfb249e01" candidate_uuid: "7101301231b84cbca942f8d6caec5bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f29bf870fd64787bef834aa6f611bff" is_pre_election: true
I20260811 06:54:36.394261 13781 raft_consensus.cc:2454] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7101301231b84cbca942f8d6caec5bb8 in term 0.
I20260811 06:54:36.394147 13326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddd609cf10443f781d5446cfb249e01" candidate_uuid: "7101301231b84cbca942f8d6caec5bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" is_pre_election: true
I20260811 06:54:36.394672 13326 raft_consensus.cc:2454] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7101301231b84cbca942f8d6caec5bb8 in term 0.
I20260811 06:54:36.394927 13441 leader_election.cc:302] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f29bf870fd64787bef834aa6f611bff, 7101301231b84cbca942f8d6caec5bb8; no voters:
I20260811 06:54:36.395337 13900 raft_consensus.cc:2781] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:54:36.395507 13900 raft_consensus.cc:482] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:54:36.395623 13900 raft_consensus.cc:3037] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:36.398113 13900 raft_consensus.cc:504] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 } } peers { permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 } } peers { permanent_uuid: "7101301231b84cbca942f8d6caec5bb8" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 39033 } }
I20260811 06:54:36.398734 13900 leader_election.cc:288] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5f29bf870fd64787bef834aa6f611bff (127.12.145.3:39073), fde8d0289f0c4e119b7d9d15c5fe2925 (127.12.145.1:41973)
I20260811 06:54:36.399207 13326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddd609cf10443f781d5446cfb249e01" candidate_uuid: "7101301231b84cbca942f8d6caec5bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925"
I20260811 06:54:36.399196 13781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddd609cf10443f781d5446cfb249e01" candidate_uuid: "7101301231b84cbca942f8d6caec5bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f29bf870fd64787bef834aa6f611bff"
I20260811 06:54:36.399387 13326 raft_consensus.cc:3037] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:36.399411 13781 raft_consensus.cc:3037] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:36.401886 13326 raft_consensus.cc:2454] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7101301231b84cbca942f8d6caec5bb8 in term 1.
I20260811 06:54:36.401912 13781 raft_consensus.cc:2454] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7101301231b84cbca942f8d6caec5bb8 in term 1.
I20260811 06:54:36.402279 13441 leader_election.cc:302] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7101301231b84cbca942f8d6caec5bb8, fde8d0289f0c4e119b7d9d15c5fe2925; no voters:
I20260811 06:54:36.402571 13900 raft_consensus.cc:2781] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:36.403059 13900 raft_consensus.cc:686] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 7101301231b84cbca942f8d6caec5bb8, State: Running, Role: LEADER
I20260811 06:54:36.403564 13900 consensus_queue.cc:237] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 } } peers { permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 } } peers { permanent_uuid: "7101301231b84cbca942f8d6caec5bb8" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 39033 } }
I20260811 06:54:36.408397 13101 catalog_manager.cc:5495] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7101301231b84cbca942f8d6caec5bb8 (127.12.145.2). New cstate: current_term: 1 leader_uuid: "7101301231b84cbca942f8d6caec5bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7101301231b84cbca942f8d6caec5bb8" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 39033 } health_report { overall_health: HEALTHY } } }
I20260811 06:54:36.447396 13880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.441879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36046 (local address 127.12.145.2:39033)
0811 06:54:36.442094 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.442100 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.442189 (+ 89us) server_negotiation.cc:407] Connection header received
0811 06:54:36.442431 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.442435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.442534 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.442666 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:54:36.443071 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.443807 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.445182 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.445658 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.445801 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.446277 (+ 476us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:54:36.446793 (+ 516us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:54:36.446929 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.447056 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.447139 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:54:36.455571 13781 raft_consensus.cc:1261] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff [term 1 FOLLOWER]: Refusing update from remote peer 7101301231b84cbca942f8d6caec5bb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:36.455569 13326 raft_consensus.cc:1261] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925 [term 1 FOLLOWER]: Refusing update from remote peer 7101301231b84cbca942f8d6caec5bb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:36.456549 13908 consensus_queue.cc:1035] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fde8d0289f0c4e119b7d9d15c5fe2925" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:36.456957 13900 consensus_queue.cc:1035] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f29bf870fd64787bef834aa6f611bff" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 39073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:36.475610 13915 mvcc.cc:205] Tried to move back new op lower bound from 7317222508351504384 to 7317222508152954880. Current Snapshot: MvccSnapshot[applied={T|T < 7317222508351504384}]
I20260811 06:54:36.485172 13101 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:36.485489 13101 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:36.489424 13101 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 04614f3a4a344a2baf1f83956e4bde9b: Sending DeleteTablet for 3 replicas of tablet 4ddd609cf10443f781d5446cfb249e01
I20260811 06:54:36.490810 13294 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ddd609cf10443f781d5446cfb249e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:36 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:35592
I20260811 06:54:36.491039 13743 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ddd609cf10443f781d5446cfb249e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:36 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:56112
I20260811 06:54:36.491633 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 13202
I20260811 06:54:36.491961 13517 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ddd609cf10443f781d5446cfb249e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:36 UTC) from {username='kudu', principal='kudu/127.12.145.62@KRBTEST.COM'} at 127.0.0.1:36044
I20260811 06:54:36.495178 13930 tablet_replica.cc:330] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: stopping tablet replica
I20260811 06:54:36.495566 13930 raft_consensus.cc:2229] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:36.496011 13930 raft_consensus.cc:2258] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:36.498381 13930 ts_tablet_manager.cc:1905] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:36.499468 13931 tablet_replica.cc:330] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: stopping tablet replica
I20260811 06:54:36.499943 13931 raft_consensus.cc:2229] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:54:36.501376 13931 raft_consensus.cc:2258] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:36.503926 13931 ts_tablet_manager.cc:1905] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:36.504029 13928 tablet_replica.cc:330] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: stopping tablet replica
I20260811 06:54:36.504520 13928 raft_consensus.cc:2229] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:36.505879 13930 ts_tablet_manager.cc:1918] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:36.506098 13930 log.cc:1196] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/4ddd609cf10443f781d5446cfb249e01
I20260811 06:54:36.506735 13930 ts_tablet_manager.cc:1939] T 4ddd609cf10443f781d5446cfb249e01 P 5f29bf870fd64787bef834aa6f611bff: Deleting consensus metadata
I20260811 06:54:36.506822 13928 raft_consensus.cc:2258] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:36.508848 13073 catalog_manager.cc:4841] TS 5f29bf870fd64787bef834aa6f611bff (127.12.145.3:39073): tablet 4ddd609cf10443f781d5446cfb249e01 (table test-table [id=f6165e2e46864dcfbb8574d83e948675]) successfully deleted
Aug 11 06:54:36 dist-test-slave-7lbf krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.1@KRBTEST.COM
I20260811 06:54:36.512399 13928 ts_tablet_manager.cc:1905] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:36.513127 13931 ts_tablet_manager.cc:1918] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:36.513388 13931 log.cc:1196] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/4ddd609cf10443f781d5446cfb249e01
I20260811 06:54:36.514359 13931 ts_tablet_manager.cc:1939] T 4ddd609cf10443f781d5446cfb249e01 P 7101301231b84cbca942f8d6caec5bb8: Deleting consensus metadata
I20260811 06:54:36.516251 13077 catalog_manager.cc:4841] TS 7101301231b84cbca942f8d6caec5bb8 (127.12.145.2:39033): tablet 4ddd609cf10443f781d5446cfb249e01 (table test-table [id=f6165e2e46864dcfbb8574d83e948675]) successfully deleted
I20260811 06:54:36.519075 13886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.493022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35594 (local address 127.12.145.1:41973)
0811 06:54:36.493212 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.493218 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.496743 (+ 3525us) server_negotiation.cc:407] Connection header received
0811 06:54:36.497038 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.497044 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.497136 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.497210 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:36.500536 (+ 3326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.501924 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.504764 (+ 2840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.505407 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.505546 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.511497 (+ 5951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:36.511511 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:36.511529 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:36.511573 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:36.515428 (+ 3855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:36.516318 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:36.516328 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:36.516331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:36.516521 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:36.517065 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:36.517070 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:36.517074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:36.517664 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:36.518015 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.518323 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.518584 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:54:36.519348 13928 ts_tablet_manager.cc:1918] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:36.519521 13928 log.cc:1196] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/4ddd609cf10443f781d5446cfb249e01
I20260811 06:54:36.520052 13398 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:36.621241 13928 ts_tablet_manager.cc:1939] T 4ddd609cf10443f781d5446cfb249e01 P fde8d0289f0c4e119b7d9d15c5fe2925: Deleting consensus metadata
I20260811 06:54:36.621999 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 13202
W20260811 06:54:36.646693 13073 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.1:41973 (error 108)
I20260811 06:54:36.647568 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 13418
I20260811 06:54:36.649006 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.648410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41973 (local address 127.0.0.1:35604)
0811 06:54:36.648677 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.648811 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260811 06:54:36.649292 13073 catalog_manager.cc:4584] TS fde8d0289f0c4e119b7d9d15c5fe2925 (127.12.145.1:41973): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4ddd609cf10443f781d5446cfb249e01: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41973: connect: Connection refused (error 111)
Aug 11 06:54:36 dist-test-slave-7lbf krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.2@KRBTEST.COM
I20260811 06:54:36.664363 13880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.648425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36056 (local address 127.12.145.2:39033)
0811 06:54:36.648621 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.648627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.648724 (+ 97us) server_negotiation.cc:407] Connection header received
0811 06:54:36.648923 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.648928 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.649000 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.649119 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:36.650619 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.651468 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.652794 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.653219 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.653342 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.658025 (+ 4683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:36.658042 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:36.658059 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:36.658101 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:36.661169 (+ 3068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:36.662135 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:36.662143 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:36.662146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:36.662298 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:36.662695 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:36.662700 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:36.662704 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:36.663100 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:36.663433 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.663794 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.664014 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 06:54:36.665162 13621 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:36.703440 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.702765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41973 (local address 127.0.0.1:35614)
0811 06:54:36.703079 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.703202 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
I20260811 06:54:36.704692 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.704260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41973 (local address 127.0.0.1:35630)
0811 06:54:36.704437 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.704546 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 06:54:36.765281 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.764691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41973 (local address 127.0.0.1:35634)
0811 06:54:36.764957 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.765072 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 06:54:36.766433 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.766034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41973 (local address 127.0.0.1:35642)
0811 06:54:36.766196 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.766285 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 06:54:36.779826 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 13418
I20260811 06:54:36.808276 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 13646
Aug 11 06:54:36 dist-test-slave-7lbf krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.3@KRBTEST.COM
I20260811 06:54:36.822784 13876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.809020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56124 (local address 127.12.145.3:39073)
0811 06:54:36.809178 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:36.809182 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:36.809240 (+ 58us) server_negotiation.cc:407] Connection header received
0811 06:54:36.809381 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:36.809385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:36.809461 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:36.809581 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:36.810889 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.811604 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.812810 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:36.813190 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:36.813281 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:36.817508 (+ 4227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:36.817545 (+ 37us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:36.817568 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:36.817607 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:36.820163 (+ 2556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:36.820737 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:36.820745 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:36.820747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:36.820890 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:36.821258 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:36.821263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:36.821265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:36.821830 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:36.822077 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:36.822297 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 06:54:36.822466 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 06:54:36.823534 13847 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:36.846989 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.846488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41973 (local address 127.0.0.1:35656)
0811 06:54:36.846699 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.846792 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 06:54:36.848111 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:36.847715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41973 (local address 127.0.0.1:35666)
0811 06:54:36.847908 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:36.847990 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260811 06:54:36.912621 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 13646
I20260811 06:54:36.932427 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 13054
I20260811 06:54:36.933616 13148 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:37.045303 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:37.044737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:41973 (local address 127.0.0.1:35676)
0811 06:54:37.044968 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:37.045110 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.1:41973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 06:54:37.046058 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 13054
2026-08-11T06:54:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4664 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T06:54:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:37Z Disabled control of system clock
I20260811 06:54:37.144680 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35397
--webserver_interface=127.12.145.62
--webserver_port=0
--builtin_ntp_servers=127.12.145.20:44585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:35397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 06:54:37.482445 13951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:37.482765 13951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:37.482897 13951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:37.490141 13951 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:37.490273 13951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:37.490337 13951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:37.490420 13951 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:37.490482 13951 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:37.499810 13951 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:44585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:35397
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:35397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:37.501194 13951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:37.503068 13951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:37.514503 13957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:37.514585 13958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:37.514616 13963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:37.515483 13951 server_base.cc:1034] running on GCE node
I20260811 06:54:37.516238 13951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:37.517638 13951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:37.518844 13951 hybrid_clock.cc:648] HybridClock initialized: now 1786431277518790 us; error 50 us; skew 500 ppm
I20260811 06:54:37.519189 13951 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:37.521377 13951 webserver.cc:460] Webserver started at http://127.12.145.62:37527/ using document root <none> and password file <none>
I20260811 06:54:37.522094 13951 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:37.522203 13951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:37.522516 13951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:37.525411 13951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "2c6fae4210f649d6a8795e1370cc3c01"
format_stamp: "Formatted at 2026-08-11 06:54:37 on dist-test-slave-7lbf"
server_key: "e7cb9350740395618a2a4dce58dbf9db"
server_key_iv: "aaf3ede3a3ca73ee92808ea6b8f82c43"
server_key_version: "encryptionkey@0"
I20260811 06:54:37.526289 13951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "2c6fae4210f649d6a8795e1370cc3c01"
format_stamp: "Formatted at 2026-08-11 06:54:37 on dist-test-slave-7lbf"
server_key: "e7cb9350740395618a2a4dce58dbf9db"
server_key_iv: "aaf3ede3a3ca73ee92808ea6b8f82c43"
server_key_version: "encryptionkey@0"
I20260811 06:54:37.531685 13951 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:54:37.535256 13972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:37.536613 13951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:54:37.536784 13951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "2c6fae4210f649d6a8795e1370cc3c01"
format_stamp: "Formatted at 2026-08-11 06:54:37 on dist-test-slave-7lbf"
server_key: "e7cb9350740395618a2a4dce58dbf9db"
server_key_iv: "aaf3ede3a3ca73ee92808ea6b8f82c43"
server_key_version: "encryptionkey@0"
I20260811 06:54:37.536998 13951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:37.560910 13951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:37.561900 13951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:37.562201 13951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:37.580484 13951 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:35397
I20260811 06:54:37.580492 14057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:35397 every 8 connection(s)
I20260811 06:54:37.581872 13951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:37.585718 14059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:37.592159 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 13951
I20260811 06:54:37.592339 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:37.592916 12868 external_mini_cluster.cc:1428] Setting key cde1b97a5e29bf4ba00067e472f1d3f1
I20260811 06:54:37.596907 14059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01: Bootstrap starting.
I20260811 06:54:37.600277 14059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:37.601637 14059 log.cc:824] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:37.605108 14059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01: No bootstrap required, opened a new log
I20260811 06:54:37.607285 14062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:37.594898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54278 (local address 127.12.145.62:35397)
0811 06:54:37.595889 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:37.595899 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:37.595942 (+ 43us) server_negotiation.cc:407] Connection header received
0811 06:54:37.597706 (+ 1764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:37.597731 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:37.598177 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:37.598514 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:37.599109 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:37.600390 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:37.602330 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:37.603309 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:37.603456 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:37.604738 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:37.604745 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:37.604760 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:37.605423 (+ 663us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:37.605559 (+ 136us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:37.605588 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:37.605707 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:37.605950 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 06:54:37.606278 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":331,"threads_started":1}
I20260811 06:54:37.613494 14059 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6fae4210f649d6a8795e1370cc3c01" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35397 } }
I20260811 06:54:37.614032 14059 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:37.614144 14059 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c6fae4210f649d6a8795e1370cc3c01, State: Initialized, Role: FOLLOWER
I20260811 06:54:37.614936 14059 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6fae4210f649d6a8795e1370cc3c01" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35397 } }
I20260811 06:54:37.615195 14059 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:37.615329 14059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:37.615495 14059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:37.617697 14059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6fae4210f649d6a8795e1370cc3c01" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35397 } }
I20260811 06:54:37.618194 14059 leader_election.cc:302] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c6fae4210f649d6a8795e1370cc3c01; no voters:
I20260811 06:54:37.618772 14059 leader_election.cc:288] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:37.618958 14065 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:37.619625 14065 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [term 1 LEADER]: Becoming Leader. State: Replica: 2c6fae4210f649d6a8795e1370cc3c01, State: Running, Role: LEADER
I20260811 06:54:37.620136 14065 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6fae4210f649d6a8795e1370cc3c01" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35397 } }
I20260811 06:54:37.620779 14059 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:37.622979 14068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c6fae4210f649d6a8795e1370cc3c01. Latest consensus state: current_term: 1 leader_uuid: "2c6fae4210f649d6a8795e1370cc3c01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6fae4210f649d6a8795e1370cc3c01" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35397 } } }
I20260811 06:54:37.623545 14068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:37.623026 14067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c6fae4210f649d6a8795e1370cc3c01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6fae4210f649d6a8795e1370cc3c01" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 35397 } } }
I20260811 06:54:37.624477 14067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:37.624526 14075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:37.630554 14075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:37.640587 14075 catalog_manager.cc:1347] Generated new cluster ID: f1fbb3e7d053449696b190ededb12900
I20260811 06:54:37.640704 14075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:37.663772 14075 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:37.665153 14075 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:37.675383 14075 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01: Generated new TSK 0
I20260811 06:54:37.676265 14075 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:37.681576 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.1:0
--local_ip_for_outbound_sockets=127.12.145.1
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35397
--builtin_ntp_servers=127.12.145.20:44585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 06:54:38.045174 14094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:38.045454 14094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:38.045574 14094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:38.052733 14094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:38.052839 14094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:38.052944 14094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.1
I20260811 06:54:38.062031 14094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:44585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.1
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.1
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:38.063289 14094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:38.065057 14094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:38.077728 14102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:38.077693 14100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:38.077695 14104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:38.078625 14094 server_base.cc:1034] running on GCE node
I20260811 06:54:38.079224 14094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:38.080188 14094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:38.081439 14094 hybrid_clock.cc:648] HybridClock initialized: now 1786431278081377 us; error 59 us; skew 500 ppm
I20260811 06:54:38.081805 14094 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:38.084043 14094 webserver.cc:460] Webserver started at http://127.12.145.1:42095/ using document root <none> and password file <none>
I20260811 06:54:38.084731 14094 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:38.084836 14094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:38.085232 14094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:38.088174 14094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/data/instance:
uuid: "08cf37d8dee3409caec3ac435a3408e7"
format_stamp: "Formatted at 2026-08-11 06:54:38 on dist-test-slave-7lbf"
server_key: "9a29d77b4938ce74f584344e23252e1c"
server_key_iv: "fd8159dd577b33e46b363253800082c9"
server_key_version: "encryptionkey@0"
I20260811 06:54:38.088954 14094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance:
uuid: "08cf37d8dee3409caec3ac435a3408e7"
format_stamp: "Formatted at 2026-08-11 06:54:38 on dist-test-slave-7lbf"
server_key: "9a29d77b4938ce74f584344e23252e1c"
server_key_iv: "fd8159dd577b33e46b363253800082c9"
server_key_version: "encryptionkey@0"
I20260811 06:54:38.094125 14094 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:54:38.097644 14122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:38.099042 14094 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:54:38.099195 14094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/wal
uuid: "08cf37d8dee3409caec3ac435a3408e7"
format_stamp: "Formatted at 2026-08-11 06:54:38 on dist-test-slave-7lbf"
server_key: "9a29d77b4938ce74f584344e23252e1c"
server_key_iv: "fd8159dd577b33e46b363253800082c9"
server_key_version: "encryptionkey@0"
I20260811 06:54:38.099397 14094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:38.114303 14094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:38.115139 14094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:38.115437 14094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:38.116427 14094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:38.117990 14094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:38.118091 14094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:38.118201 14094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:38.118271 14094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:38.148957 14094 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.1:44567
I20260811 06:54:38.149017 14303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.1:44567 every 8 connection(s)
I20260811 06:54:38.150323 14094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/data/info.pb
I20260811 06:54:38.158268 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 14094
I20260811 06:54:38.158469 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/wal/instance
I20260811 06:54:38.158928 12868 external_mini_cluster.cc:1428] Setting key b003fd516312e45edfae1e64090f0436
I20260811 06:54:38.161638 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.2:0
--local_ip_for_outbound_sockets=127.12.145.2
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35397
--builtin_ntp_servers=127.12.145.20:44585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 06:54:38.162636 14317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:38.152793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.1:37275 (local address 127.12.145.62:35397)
0811 06:54:38.153208 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:38.153213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:38.154332 (+ 1119us) server_negotiation.cc:407] Connection header received
0811 06:54:38.156142 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:38.156149 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:38.156237 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:38.156336 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:38.157411 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:38.158344 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:38.159970 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:38.160394 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:38.160523 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:38.161887 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:38.161892 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:38.161896 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:38.161912 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:38.161953 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:38.161980 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:38.162048 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:38.162289 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 06:54:38.162375 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":210,"threads_started":1}
I20260811 06:54:38.164013 14319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:38.153279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35397 (local address 127.12.145.1:37275)
0811 06:54:38.154175 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:38.154211 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:38.155866 (+ 1655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:38.156586 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:38.156594 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:38.156680 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:38.157243 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:38.157260 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:38.158518 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:38.158522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:38.159810 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:38.159824 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:38.160628 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:38.160636 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:38.160842 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:38.161560 (+ 718us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:54:38.161562 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:38.161605 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:54:38.161682 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:38.162078 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:38.162090 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:38.162099 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 06:54:38.162290 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 06:54:38.162681 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":300,"threads_started":1}
I20260811 06:54:38.165560 14305 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35397
I20260811 06:54:38.165838 14305 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:38.166584 14305 heartbeater.cc:511] Master 127.12.145.62:35397 requested a full tablet report, sending...
I20260811 06:54:38.168776 13997 ts_manager.cc:194] Registered new tserver with Master: 08cf37d8dee3409caec3ac435a3408e7 (127.12.145.1:44567)
I20260811 06:54:38.170748 13997 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.1:37275
W20260811 06:54:38.511880 14322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:38.512153 14322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:38.512245 14322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:38.519308 14322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:38.519413 14322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:38.519531 14322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.2
I20260811 06:54:38.528743 14322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:44585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.2
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.2
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:38.530146 14322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:38.532372 14322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:38.545457 14334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:38.545430 14335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:38.545387 14338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:38.546198 14322 server_base.cc:1034] running on GCE node
I20260811 06:54:38.546806 14322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:38.547716 14322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:38.548918 14322 hybrid_clock.cc:648] HybridClock initialized: now 1786431278548873 us; error 32 us; skew 500 ppm
I20260811 06:54:38.549211 14322 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:38.551344 14322 webserver.cc:460] Webserver started at http://127.12.145.2:44257/ using document root <none> and password file <none>
I20260811 06:54:38.552006 14322 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:38.552096 14322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:38.552363 14322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:38.555270 14322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/data/instance:
uuid: "439c615412c644ec9057335acde98a37"
format_stamp: "Formatted at 2026-08-11 06:54:38 on dist-test-slave-7lbf"
server_key: "44caad4d066aebb8c6d9962af0fa18fc"
server_key_iv: "3fb7d46a216dbef327f7250507547b29"
server_key_version: "encryptionkey@0"
I20260811 06:54:38.556025 14322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance:
uuid: "439c615412c644ec9057335acde98a37"
format_stamp: "Formatted at 2026-08-11 06:54:38 on dist-test-slave-7lbf"
server_key: "44caad4d066aebb8c6d9962af0fa18fc"
server_key_iv: "3fb7d46a216dbef327f7250507547b29"
server_key_version: "encryptionkey@0"
I20260811 06:54:38.561060 14322 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:54:38.564733 14350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:38.566200 14322 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:54:38.566354 14322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/wal
uuid: "439c615412c644ec9057335acde98a37"
format_stamp: "Formatted at 2026-08-11 06:54:38 on dist-test-slave-7lbf"
server_key: "44caad4d066aebb8c6d9962af0fa18fc"
server_key_iv: "3fb7d46a216dbef327f7250507547b29"
server_key_version: "encryptionkey@0"
I20260811 06:54:38.566574 14322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:38.604275 14322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:38.605142 14322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:38.605437 14322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:38.606570 14322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:38.608090 14322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:38.608191 14322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:38.608295 14322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:38.608366 14322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:38.638636 14322 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.2:32839
I20260811 06:54:38.638708 14539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.2:32839 every 8 connection(s)
I20260811 06:54:38.640054 14322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/data/info.pb
I20260811 06:54:38.644272 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 14322
I20260811 06:54:38.644470 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/wal/instance
I20260811 06:54:38.645159 12868 external_mini_cluster.cc:1428] Setting key 6ee087672c40c192ecf3bc00dad032d6
I20260811 06:54:38.648439 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.3:0
--local_ip_for_outbound_sockets=127.12.145.3
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35397
--builtin_ntp_servers=127.12.145.20:44585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 06:54:38.654362 14317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:38.642737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.2:36269 (local address 127.12.145.62:35397)
0811 06:54:38.642954 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:38.642960 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:38.644614 (+ 1654us) server_negotiation.cc:407] Connection header received
0811 06:54:38.646933 (+ 2319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:38.646937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:38.647012 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:38.647100 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:38.648817 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:38.649573 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:38.651683 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:38.652155 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:38.652251 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:38.653703 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:38.653707 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:38.653711 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:38.653729 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:38.653760 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:38.653771 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:38.653837 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:38.654060 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 06:54:38.654141 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 06:54:38.655742 14543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:38.643287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35397 (local address 127.12.145.2:36269)
0811 06:54:38.644430 (+ 1143us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:38.644490 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:38.646635 (+ 2145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:38.647686 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:38.647699 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:38.647817 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:38.648650 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:38.648679 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:38.649730 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:38.649734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:38.651561 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:38.651576 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:38.652376 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:38.652382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:38.652643 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:38.653348 (+ 705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:54:38.653351 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:38.653404 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:54:38.653509 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:38.653856 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:38.653866 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:38.653872 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 06:54:38.654043 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 06:54:38.654443 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":327,"threads_started":1}
I20260811 06:54:38.657151 14541 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35397
I20260811 06:54:38.657456 14541 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:38.658224 14541 heartbeater.cc:511] Master 127.12.145.62:35397 requested a full tablet report, sending...
I20260811 06:54:38.659582 13997 ts_manager.cc:194] Registered new tserver with Master: 439c615412c644ec9057335acde98a37 (127.12.145.2:32839)
I20260811 06:54:38.660394 13997 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.2:36269
W20260811 06:54:38.992558 14545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:38.992849 14545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:38.992950 14545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:39.000113 14545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:39.000207 14545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:39.000355 14545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.3
I20260811 06:54:39.009835 14545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:44585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.3
--webserver_port=0
--tserver_master_addrs=127.12.145.62:35397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.3
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:39.011117 14545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:39.012945 14545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:39.025954 14555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:39.026005 14554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:39.026010 14561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:39.026983 14545 server_base.cc:1034] running on GCE node
I20260811 06:54:39.027558 14545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:39.028447 14545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:39.029652 14545 hybrid_clock.cc:648] HybridClock initialized: now 1786431279029594 us; error 48 us; skew 500 ppm
I20260811 06:54:39.029990 14545 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:54:39.032261 14545 webserver.cc:460] Webserver started at http://127.12.145.3:35055/ using document root <none> and password file <none>
I20260811 06:54:39.032920 14545 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:39.033010 14545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:39.033272 14545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:39.036211 14545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/data/instance:
uuid: "5e37362afd8145919af93851fd130127"
format_stamp: "Formatted at 2026-08-11 06:54:39 on dist-test-slave-7lbf"
server_key: "1b7a1eddb663d36b462d94de5a5cd4f6"
server_key_iv: "dc7664fb8691b3b6b3bdb7a808219035"
server_key_version: "encryptionkey@0"
I20260811 06:54:39.036969 14545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance:
uuid: "5e37362afd8145919af93851fd130127"
format_stamp: "Formatted at 2026-08-11 06:54:39 on dist-test-slave-7lbf"
server_key: "1b7a1eddb663d36b462d94de5a5cd4f6"
server_key_iv: "dc7664fb8691b3b6b3bdb7a808219035"
server_key_version: "encryptionkey@0"
I20260811 06:54:39.042210 14545 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260811 06:54:39.045681 14576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:39.046999 14545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:54:39.047135 14545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/wal
uuid: "5e37362afd8145919af93851fd130127"
format_stamp: "Formatted at 2026-08-11 06:54:39 on dist-test-slave-7lbf"
server_key: "1b7a1eddb663d36b462d94de5a5cd4f6"
server_key_iv: "dc7664fb8691b3b6b3bdb7a808219035"
server_key_version: "encryptionkey@0"
I20260811 06:54:39.047312 14545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:39.067114 14545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:39.068073 14545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:39.068359 14545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:39.069423 14545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:54:39.071198 14545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:54:39.071306 14545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:39.071414 14545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:54:39.071477 14545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:39.102313 14545 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.3:38089
I20260811 06:54:39.102387 14767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.3:38089 every 8 connection(s)
I20260811 06:54:39.103668 14545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/data/info.pb
I20260811 06:54:39.110999 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 14545
I20260811 06:54:39.111156 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/wal/instance
I20260811 06:54:39.111769 12868 external_mini_cluster.cc:1428] Setting key 315034f79c49f9416c07bef47076fedc
I20260811 06:54:39.116425 14317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.106207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:48853 (local address 127.12.145.62:35397)
0811 06:54:39.106374 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.106379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.107688 (+ 1309us) server_negotiation.cc:407] Connection header received
0811 06:54:39.109481 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.109488 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.109596 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.109687 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:39.110759 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.111590 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.113749 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.114218 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.114338 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.115631 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:39.115636 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:39.115640 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:39.115657 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:39.115691 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:39.115703 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:39.115777 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.115994 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.116094 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 06:54:39.117403 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.106641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:35397 (local address 127.12.145.3:48853)
0811 06:54:39.107526 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:39.107572 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:39.109207 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:39.109921 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:39.109929 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:39.110014 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:54:39.110580 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.110599 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.111776 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.111782 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.113601 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.113617 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.114443 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.114451 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.114686 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.115317 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 06:54:39.115320 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:54:39.115360 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 06:54:39.115442 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:54:39.115793 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:54:39.115805 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:54:39.115813 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 06:54:39.115976 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 06:54:39.116372 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":273,"threads_started":1}
I20260811 06:54:39.118785 14768 heartbeater.cc:347] Connected to a master server at 127.12.145.62:35397
I20260811 06:54:39.119060 14768 heartbeater.cc:464] Registering TS with master...
I20260811 06:54:39.119761 14768 heartbeater.cc:511] Master 127.12.145.62:35397 requested a full tablet report, sending...
I20260811 06:54:39.121176 13997 ts_manager.cc:194] Registered new tserver with Master: 5e37362afd8145919af93851fd130127 (127.12.145.3:38089)
I20260811 06:54:39.122013 13997 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.3:48853
I20260811 06:54:39.126942 12868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:54:39.136372 14317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.130970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49336 (local address 127.12.145.62:35397)
0811 06:54:39.131159 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.131165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.131598 (+ 433us) server_negotiation.cc:407] Connection header received
0811 06:54:39.131741 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.131745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.131820 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.131895 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:39.132323 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.133019 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.134374 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.134776 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.134867 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.135775 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:39.135780 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:39.135783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:39.135799 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:39.135830 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:39.135841 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:39.135907 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.136011 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.136084 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 06:54:39.139828 13997 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:54:39.146700 13997 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:54:39.170648 14792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.160047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44567 (local address 127.0.0.1:34948)
0811 06:54:39.161783 (+ 1736us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:39.161801 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:39.161912 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:39.163349 (+ 1437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:39.163356 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:39.163385 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:39.163827 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.163845 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.165763 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.165768 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.167723 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.167736 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.169488 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.169501 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.169760 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.169832 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 06:54:39.169952 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 06:54:39.170136 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1586,"mutex_wait_us":1,"thread_start_us":1462,"threads_started":1}
I20260811 06:54:39.170688 14793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.160688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34948 (local address 127.12.145.1:44567)
0811 06:54:39.162736 (+ 2048us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.162745 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.162776 (+ 31us) server_negotiation.cc:407] Connection header received
0811 06:54:39.162877 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.162886 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.163147 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.163349 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:39.164035 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.165620 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.167921 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.169266 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.169412 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.169752 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.170110 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.170300 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1882,"thread_start_us":1763,"threads_started":1}
I20260811 06:54:39.171334 14790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.159547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.3:38089 (local address 127.0.0.1:37686)
0811 06:54:39.160860 (+ 1313us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:39.160915 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:39.161094 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:39.164078 (+ 2984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:39.164084 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:39.164116 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:39.164506 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.164520 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.166683 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.166688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.168724 (+ 2036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.168742 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.170525 (+ 1783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.170545 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.170724 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.170756 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 06:54:39.170821 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 06:54:39.170955 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1027,"mutex_wait_us":77,"thread_start_us":841,"threads_started":1}
I20260811 06:54:39.172444 14791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.159629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37686 (local address 127.12.145.3:38089)
0811 06:54:39.163405 (+ 3776us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.163415 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.163464 (+ 49us) server_negotiation.cc:407] Connection header received
0811 06:54:39.163576 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.163585 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.163832 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.164726 (+ 894us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:39.165054 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.166510 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.168941 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.170313 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.171572 (+ 1259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.171835 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.171908 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.172084 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3583,"thread_start_us":2507,"threads_started":1}
I20260811 06:54:39.173484 14795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.161178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:32839 (local address 127.0.0.1:47548)
0811 06:54:39.163964 (+ 2786us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:39.163990 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:39.164102 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:39.164588 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:39.164592 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:39.164614 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:39.164908 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.164917 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.166709 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.166715 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.169601 (+ 2886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.169621 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.172755 (+ 3134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.172761 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.172928 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.172960 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 06:54:39.173052 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 06:54:39.173169 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2669,"mutex_wait_us":1118,"thread_start_us":2516,"threads_started":1}
I20260811 06:54:39.173918 14800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.161752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47548 (local address 127.12.145.2:32839)
0811 06:54:39.163084 (+ 1332us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.163095 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.164091 (+ 996us) server_negotiation.cc:407] Connection header received
0811 06:54:39.164251 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.164257 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.164408 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.164573 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:39.165071 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.166541 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.169819 (+ 3278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.172257 (+ 2438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.172386 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.172628 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.173129 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.173298 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1152,"thread_start_us":1024,"threads_started":1}
I20260811 06:54:39.174573 14305 heartbeater.cc:503] Master 127.12.145.62:35397 was elected leader, sending a full tablet report...
I20260811 06:54:39.175441 14202 tablet_service.cc:1467] Processing CreateTablet for tablet 72d2fdcdd73b4544b5dffc79aaca7bcd (DEFAULT_TABLE table=test-table [id=b0c6a5608a984ef9a81758d12e09d70e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:39.175962 14668 tablet_service.cc:1467] Processing CreateTablet for tablet 72d2fdcdd73b4544b5dffc79aaca7bcd (DEFAULT_TABLE table=test-table [id=b0c6a5608a984ef9a81758d12e09d70e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:39.177073 14202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d2fdcdd73b4544b5dffc79aaca7bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:39.177122 14668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d2fdcdd73b4544b5dffc79aaca7bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:39.177796 14438 tablet_service.cc:1467] Processing CreateTablet for tablet 72d2fdcdd73b4544b5dffc79aaca7bcd (DEFAULT_TABLE table=test-table [id=b0c6a5608a984ef9a81758d12e09d70e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:54:39.179177 14438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d2fdcdd73b4544b5dffc79aaca7bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:39.188144 14801 tablet_bootstrap.cc:492] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: Bootstrap starting.
I20260811 06:54:39.192178 14802 tablet_bootstrap.cc:492] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: Bootstrap starting.
I20260811 06:54:39.192265 14801 tablet_bootstrap.cc:654] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:39.193786 14801 log.cc:824] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:39.193991 14803 tablet_bootstrap.cc:492] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: Bootstrap starting.
I20260811 06:54:39.195677 14802 tablet_bootstrap.cc:654] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:39.196633 14802 log.cc:824] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:39.197767 14803 tablet_bootstrap.cc:654] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:39.197903 14801 tablet_bootstrap.cc:492] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: No bootstrap required, opened a new log
I20260811 06:54:39.198199 14801 ts_tablet_manager.cc:1397] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20260811 06:54:39.199186 14802 tablet_bootstrap.cc:492] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: No bootstrap required, opened a new log
I20260811 06:54:39.199133 14803 log.cc:824] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:39.199430 14802 ts_tablet_manager.cc:1397] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 06:54:39.203683 14803 tablet_bootstrap.cc:492] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: No bootstrap required, opened a new log
I20260811 06:54:39.203969 14803 ts_tablet_manager.cc:1397] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260811 06:54:39.207442 14802 raft_consensus.cc:348] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e37362afd8145919af93851fd130127" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38089 } } peers { permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 } } peers { permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 } }
I20260811 06:54:39.207793 14802 raft_consensus.cc:374] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:39.207896 14802 raft_consensus.cc:729] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08cf37d8dee3409caec3ac435a3408e7, State: Initialized, Role: FOLLOWER
I20260811 06:54:39.208482 14802 consensus_queue.cc:260] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e37362afd8145919af93851fd130127" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38089 } } peers { permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 } } peers { permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 } }
I20260811 06:54:39.209003 14801 raft_consensus.cc:348] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e37362afd8145919af93851fd130127" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38089 } } peers { permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 } } peers { permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 } }
I20260811 06:54:39.209436 14801 raft_consensus.cc:374] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:39.209581 14801 raft_consensus.cc:729] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e37362afd8145919af93851fd130127, State: Initialized, Role: FOLLOWER
I20260811 06:54:39.210147 14801 consensus_queue.cc:260] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e37362afd8145919af93851fd130127" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38089 } } peers { permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 } } peers { permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 } }
I20260811 06:54:39.210348 14802 ts_tablet_manager.cc:1428] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260811 06:54:39.211266 14768 heartbeater.cc:503] Master 127.12.145.62:35397 was elected leader, sending a full tablet report...
I20260811 06:54:39.211782 14801 ts_tablet_manager.cc:1428] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260811 06:54:39.214208 14803 raft_consensus.cc:348] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e37362afd8145919af93851fd130127" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38089 } } peers { permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 } } peers { permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 } }
I20260811 06:54:39.214651 14803 raft_consensus.cc:374] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:39.214744 14803 raft_consensus.cc:729] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 439c615412c644ec9057335acde98a37, State: Initialized, Role: FOLLOWER
I20260811 06:54:39.215267 14803 consensus_queue.cc:260] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e37362afd8145919af93851fd130127" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38089 } } peers { permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 } } peers { permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 } }
I20260811 06:54:39.216327 14541 heartbeater.cc:503] Master 127.12.145.62:35397 was elected leader, sending a full tablet report...
I20260811 06:54:39.217967 14803 ts_tablet_manager.cc:1428] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: Time spent starting tablet: real 0.014s user 0.010s sys 0.005s
W20260811 06:54:39.355274 14770 tablet.cc:2369] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:54:39.392133 14542 tablet.cc:2369] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:54:39.402688 14315 tablet.cc:2369] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:54:39.420958 14811 raft_consensus.cc:482] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:54:39.421314 14811 raft_consensus.cc:504] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e37362afd8145919af93851fd130127" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38089 } } peers { permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 } } peers { permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 } }
I20260811 06:54:39.423111 14811 leader_election.cc:288] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 439c615412c644ec9057335acde98a37 (127.12.145.2:32839), 08cf37d8dee3409caec3ac435a3408e7 (127.12.145.1:44567)
I20260811 06:54:39.430238 14793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.423562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:46409 (local address 127.12.145.1:44567)
0811 06:54:39.423755 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.423761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.424085 (+ 324us) server_negotiation.cc:407] Connection header received
0811 06:54:39.424171 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.424176 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.424268 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.424355 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:39.425068 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.426023 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.427890 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.429229 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.429414 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.429551 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.429837 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.429980 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 06:54:39.430265 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.423391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.1:44567 (local address 127.12.145.3:46409)
0811 06:54:39.423799 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:39.423819 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:39.423954 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:39.424658 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:39.424663 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:39.424693 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:39.424918 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.424929 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.426151 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.426155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.427703 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.427717 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.429404 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.429410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.429638 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.429674 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 06:54:39.429767 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 06:54:39.429906 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":1,"spinlock_wait_cycles":2816}
I20260811 06:54:39.431030 14800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.424056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.3:44203 (local address 127.12.145.2:32839)
0811 06:54:39.424266 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.424273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.424753 (+ 480us) server_negotiation.cc:407] Connection header received
0811 06:54:39.424934 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.424941 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.425071 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.425181 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 06:54:39.425794 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.426849 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.428830 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.429803 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.430016 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.430085 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.430550 (+ 465us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.430688 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 06:54:39.431037 14814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.423425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.2:32839 (local address 127.12.145.3:44203)
0811 06:54:39.424633 (+ 1208us) negotiation.cc:107] Waiting for socket to connect
0811 06:54:39.424657 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 06:54:39.424797 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:54:39.425205 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:54:39.425209 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:54:39.425236 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 06:54:39.425645 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.425658 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.427017 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.427022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.428652 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:54:39.428665 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.430186 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.430191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:54:39.430366 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.430397 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 06:54:39.430504 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 06:54:39.430639 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1085,"spinlock_wait_cycles":30848,"thread_start_us":838,"threads_started":1}
I20260811 06:54:39.432061 14236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d2fdcdd73b4544b5dffc79aaca7bcd" candidate_uuid: "5e37362afd8145919af93851fd130127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08cf37d8dee3409caec3ac435a3408e7" is_pre_election: true
I20260811 06:54:39.432180 14473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d2fdcdd73b4544b5dffc79aaca7bcd" candidate_uuid: "5e37362afd8145919af93851fd130127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "439c615412c644ec9057335acde98a37" is_pre_election: true
I20260811 06:54:39.432513 14236 raft_consensus.cc:2454] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e37362afd8145919af93851fd130127 in term 0.
I20260811 06:54:39.432773 14473 raft_consensus.cc:2454] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e37362afd8145919af93851fd130127 in term 0.
I20260811 06:54:39.433193 14577 leader_election.cc:302] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08cf37d8dee3409caec3ac435a3408e7, 5e37362afd8145919af93851fd130127; no voters:
I20260811 06:54:39.433640 14811 raft_consensus.cc:2781] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:54:39.433794 14811 raft_consensus.cc:482] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:54:39.433900 14811 raft_consensus.cc:3037] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:39.436058 14811 raft_consensus.cc:504] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e37362afd8145919af93851fd130127" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38089 } } peers { permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 } } peers { permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 } }
I20260811 06:54:39.436623 14811 leader_election.cc:288] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [CANDIDATE]: Term 1 election: Requested vote from peers 439c615412c644ec9057335acde98a37 (127.12.145.2:32839), 08cf37d8dee3409caec3ac435a3408e7 (127.12.145.1:44567)
I20260811 06:54:39.437112 14473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d2fdcdd73b4544b5dffc79aaca7bcd" candidate_uuid: "5e37362afd8145919af93851fd130127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "439c615412c644ec9057335acde98a37"
I20260811 06:54:39.437148 14236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d2fdcdd73b4544b5dffc79aaca7bcd" candidate_uuid: "5e37362afd8145919af93851fd130127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08cf37d8dee3409caec3ac435a3408e7"
I20260811 06:54:39.437294 14473 raft_consensus.cc:3037] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:39.437377 14236 raft_consensus.cc:3037] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:39.439507 14473 raft_consensus.cc:2454] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e37362afd8145919af93851fd130127 in term 1.
I20260811 06:54:39.439883 14581 leader_election.cc:302] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 439c615412c644ec9057335acde98a37, 5e37362afd8145919af93851fd130127; no voters:
I20260811 06:54:39.440133 14811 raft_consensus.cc:2781] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:39.440636 14811 raft_consensus.cc:686] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 1 LEADER]: Becoming Leader. State: Replica: 5e37362afd8145919af93851fd130127, State: Running, Role: LEADER
I20260811 06:54:39.440784 14236 raft_consensus.cc:2454] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e37362afd8145919af93851fd130127 in term 1.
I20260811 06:54:39.441414 14811 consensus_queue.cc:237] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e37362afd8145919af93851fd130127" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38089 } } peers { permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 } } peers { permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 } }
I20260811 06:54:39.446419 13997 catalog_manager.cc:5495] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e37362afd8145919af93851fd130127 (127.12.145.3). New cstate: current_term: 1 leader_uuid: "5e37362afd8145919af93851fd130127" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e37362afd8145919af93851fd130127" member_type: VOTER last_known_addr { host: "127.12.145.3" port: 38089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 } health_report { overall_health: UNKNOWN } } }
I20260811 06:54:39.466981 14791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.461677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37690 (local address 127.12.145.3:38089)
0811 06:54:39.461875 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.461880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.461939 (+ 59us) server_negotiation.cc:407] Connection header received
0811 06:54:39.462172 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.462175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.462254 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.462386 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:54:39.462738 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.463447 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.464854 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.465266 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.465375 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.465918 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:54:39.466426 (+ 508us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:54:39.466573 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.466660 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.466738 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 06:54:39.475334 14236 raft_consensus.cc:1261] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7 [term 1 FOLLOWER]: Refusing update from remote peer 5e37362afd8145919af93851fd130127: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:39.475333 14473 raft_consensus.cc:1261] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37 [term 1 FOLLOWER]: Refusing update from remote peer 5e37362afd8145919af93851fd130127: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:54:39.476379 14811 consensus_queue.cc:1035] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08cf37d8dee3409caec3ac435a3408e7" member_type: VOTER last_known_addr { host: "127.12.145.1" port: 44567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:39.476665 14817 consensus_queue.cc:1035] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [LEADER]: Connected to new peer: Peer: permanent_uuid: "439c615412c644ec9057335acde98a37" member_type: VOTER last_known_addr { host: "127.12.145.2" port: 32839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:54:39.488921 14822 mvcc.cc:205] Tried to move back new op lower bound from 7317222520720535552 to 7317222520596045824. Current Snapshot: MvccSnapshot[applied={T|T < 7317222520720535552}]
I20260811 06:54:39.519378 13997 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:39.519681 13997 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 06:54:39.524246 13997 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c6fae4210f649d6a8795e1370cc3c01: Sending DeleteTablet for 3 replicas of tablet 72d2fdcdd73b4544b5dffc79aaca7bcd
I20260811 06:54:39.525534 14668 tablet_service.cc:1514] Processing DeleteTablet for tablet 72d2fdcdd73b4544b5dffc79aaca7bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:39 UTC) from {username='slave'} at 127.0.0.1:37686
I20260811 06:54:39.525859 14202 tablet_service.cc:1514] Processing DeleteTablet for tablet 72d2fdcdd73b4544b5dffc79aaca7bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:39 UTC) from {username='slave'} at 127.0.0.1:34948
I20260811 06:54:39.526595 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 14094
I20260811 06:54:39.526623 14438 tablet_service.cc:1514] Processing DeleteTablet for tablet 72d2fdcdd73b4544b5dffc79aaca7bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:54:39 UTC) from {username='slave'} at 127.0.0.1:47548
I20260811 06:54:39.535655 14834 tablet_replica.cc:330] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: stopping tablet replica
I20260811 06:54:39.536872 14834 raft_consensus.cc:2229] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:39.538091 14834 raft_consensus.cc:2258] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:39.542364 14834 ts_tablet_manager.cc:1905] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:39.550194 14836 tablet_replica.cc:330] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: stopping tablet replica
I20260811 06:54:39.550609 14834 ts_tablet_manager.cc:1918] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:39.550868 14834 log.cc:1196] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-0/wal/wals/72d2fdcdd73b4544b5dffc79aaca7bcd
I20260811 06:54:39.551468 14834 ts_tablet_manager.cc:1939] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 08cf37d8dee3409caec3ac435a3408e7: Deleting consensus metadata
I20260811 06:54:39.553716 13973 catalog_manager.cc:4841] TS 08cf37d8dee3409caec3ac435a3408e7 (127.12.145.1:44567): tablet 72d2fdcdd73b4544b5dffc79aaca7bcd (table test-table [id=b0c6a5608a984ef9a81758d12e09d70e]) successfully deleted
I20260811 06:54:39.554406 14836 raft_consensus.cc:2229] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:54:39.554991 14836 raft_consensus.cc:2258] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:39.556478 14832 tablet_replica.cc:330] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: stopping tablet replica
I20260811 06:54:39.556914 14832 raft_consensus.cc:2229] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:54:39.557140 14836 ts_tablet_manager.cc:1905] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:39.557593 14832 raft_consensus.cc:2258] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:54:39.559420 14832 ts_tablet_manager.cc:1905] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:54:39.563756 14793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.527945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34964 (local address 127.12.145.1:44567)
0811 06:54:39.528154 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.528161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.543226 (+ 15065us) server_negotiation.cc:407] Connection header received
0811 06:54:39.544213 (+ 987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.544220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.544351 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.544456 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:39.550633 (+ 6177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.551923 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.554269 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.554936 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.555037 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.562019 (+ 6982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:39.562031 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:39.562050 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:39.562824 (+ 774us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:39.562896 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:39.562922 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:39.563018 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.563242 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.563390 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 06:54:39.563834 14836 ts_tablet_manager.cc:1918] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:39.563988 14836 log.cc:1196] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-1/wal/wals/72d2fdcdd73b4544b5dffc79aaca7bcd
I20260811 06:54:39.564519 14836 ts_tablet_manager.cc:1939] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 439c615412c644ec9057335acde98a37: Deleting consensus metadata
I20260811 06:54:39.565397 14298 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:39.566982 14832 ts_tablet_manager.cc:1918] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:54:39.567170 14832 log.cc:1196] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: Deleting WAL directory at /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786430925511755-12868-0/minicluster-data/ts-2/wal/wals/72d2fdcdd73b4544b5dffc79aaca7bcd
I20260811 06:54:39.567479 13976 catalog_manager.cc:4841] TS 439c615412c644ec9057335acde98a37 (127.12.145.2:32839): tablet 72d2fdcdd73b4544b5dffc79aaca7bcd (table test-table [id=b0c6a5608a984ef9a81758d12e09d70e]) successfully deleted
I20260811 06:54:39.567750 14832 ts_tablet_manager.cc:1939] T 72d2fdcdd73b4544b5dffc79aaca7bcd P 5e37362afd8145919af93851fd130127: Deleting consensus metadata
I20260811 06:54:39.569557 13976 catalog_manager.cc:4841] TS 5e37362afd8145919af93851fd130127 (127.12.145.3:38089): tablet 72d2fdcdd73b4544b5dffc79aaca7bcd (table test-table [id=b0c6a5608a984ef9a81758d12e09d70e]) successfully deleted
I20260811 06:54:39.717568 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 14094
I20260811 06:54:39.744936 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 14322
I20260811 06:54:39.752003 14800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.745756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47556 (local address 127.12.145.2:32839)
0811 06:54:39.745962 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.745968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.745989 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:54:39.746138 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.746143 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.746248 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.746336 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:39.746764 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.747505 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.748751 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.749191 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.749305 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.750501 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:39.750510 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:39.750526 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:39.751124 (+ 598us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:39.751174 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:39.751195 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:39.751312 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.751520 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.751633 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 06:54:39.752686 14532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:39.841128 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 14322
I20260811 06:54:39.875554 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 14545
I20260811 06:54:39.882900 14791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:39.876426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37694 (local address 127.12.145.3:38089)
0811 06:54:39.876632 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:39.876638 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:39.876658 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:54:39.876724 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:39.876729 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:39.876831 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:39.876923 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:39.877363 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.878227 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.879584 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:39.880100 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:39.880222 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:39.881412 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:39.881421 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:39.881436 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:39.882118 (+ 682us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:39.882167 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:39.882188 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:39.882289 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:39.882427 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 06:54:39.882536 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 06:54:39.883678 14762 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:40.002715 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 14545
I20260811 06:54:40.027073 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 13951
I20260811 06:54:40.028141 14049 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:40.135610 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 13951
2026-08-11T06:54:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3081 ms)
[----------] 6 tests from EncryptionPolicyTest (22733 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:40 dist-test-slave-7lbf krb5kdc[14855](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:40 dist-test-slave-7lbf krb5kdc[14855](info): set up 2 sockets
Aug 11 06:54:40 dist-test-slave-7lbf krb5kdc[14855](info): commencing operation
krb5kdc: starting...
W20260811 06:54:41.385392 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:41 dist-test-slave-7lbf krb5kdc[14855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:54:41.695247 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43073
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:42.034601 14883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:42.034905 14883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:42.035008 14883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:42.042294 14883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:42.042410 14883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:42.042471 14883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:42.042532 14883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:42.042577 14883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:42.052610 14883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43073
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:42.053989 14883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:42.055264 14883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:42.066890 14891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:42.066867 14894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:42.066836 14892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:42.067801 14883 server_base.cc:1034] running on GCE node
I20260811 06:54:42.068540 14883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:42.070044 14883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:42.071249 14883 hybrid_clock.cc:648] HybridClock initialized: now 1786431282071200 us; error 41 us; skew 500 ppm
I20260811 06:54:42.071600 14883 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:42 dist-test-slave-7lbf krb5kdc[14855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431282, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:42.074748 14883 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:54:42.076299 14883 webserver.cc:460] Webserver started at http://127.0.0.1:37267/ using document root <none> and password file <none>
I20260811 06:54:42.076977 14883 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:42.077100 14883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:42.077399 14883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:42.080489 14883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "b1bc3fb3de094490b474f29613fc6169"
format_stamp: "Formatted at 2026-08-11 06:54:42 on dist-test-slave-7lbf"
server_key: "a7c9725ed3f9ee4ca723b990a0659cad"
server_key_iv: "3c5770f9a5f8c32811ff123b04416737"
server_key_version: "encryptionkey@0"
I20260811 06:54:42.081259 14883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "b1bc3fb3de094490b474f29613fc6169"
format_stamp: "Formatted at 2026-08-11 06:54:42 on dist-test-slave-7lbf"
server_key: "a7c9725ed3f9ee4ca723b990a0659cad"
server_key_iv: "3c5770f9a5f8c32811ff123b04416737"
server_key_version: "encryptionkey@0"
I20260811 06:54:42.086624 14883 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260811 06:54:42.090046 14903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:42.091329 14883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 06:54:42.091504 14883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "b1bc3fb3de094490b474f29613fc6169"
format_stamp: "Formatted at 2026-08-11 06:54:42 on dist-test-slave-7lbf"
server_key: "a7c9725ed3f9ee4ca723b990a0659cad"
server_key_iv: "3c5770f9a5f8c32811ff123b04416737"
server_key_version: "encryptionkey@0"
I20260811 06:54:42.091696 14883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:42.104293 14883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:42.108223 14883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:42.108491 14883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:42.126609 14883 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43073
I20260811 06:54:42.126638 14981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43073 every 8 connection(s)
I20260811 06:54:42.128070 14883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:42.131949 14983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:42.136631 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 14883
I20260811 06:54:42.136880 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:42.137835 12868 external_mini_cluster.cc:1428] Setting key 8de35874f9d3c4668d0993ba8a4fb687
I20260811 06:54:42.144699 14983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169: Bootstrap starting.
I20260811 06:54:42.148691 14983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:42.150063 14983 log.cc:824] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:42.153728 14983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169: No bootstrap required, opened a new log
Aug 11 06:54:42 dist-test-slave-7lbf krb5kdc[14855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 06:54:42.162097 14983 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bc3fb3de094490b474f29613fc6169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43073 } }
I20260811 06:54:42.162532 14983 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:42.162624 14988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:42.139931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43673 (local address 127.0.0.1:43073)
0811 06:54:42.140741 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:42.140756 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:42.140803 (+ 47us) server_negotiation.cc:407] Connection header received
0811 06:54:42.142914 (+ 2111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:42.142938 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:42.143344 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:42.143675 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:42.145793 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:42.147136 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:42.149095 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:42.149828 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:42.149963 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:42.155058 (+ 5095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:42.155067 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:42.155082 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:42.155124 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:42.158341 (+ 3217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:42.159151 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:42.159158 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:42.159165 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:42.159337 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:42.159811 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:42.159814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:42.159817 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:42.160391 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:42.160722 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:42.161249 (+ 527us) server_negotiation.cc:299] Negotiation successful
0811 06:54:42.161592 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":371,"threads_started":1}
I20260811 06:54:42.162657 14983 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bc3fb3de094490b474f29613fc6169, State: Initialized, Role: FOLLOWER
I20260811 06:54:42.163259 14983 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bc3fb3de094490b474f29613fc6169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43073 } }
I20260811 06:54:42.163538 14983 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:42.163681 14983 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:42.163865 14983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:42.166683 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:54:42.166654 14983 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bc3fb3de094490b474f29613fc6169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43073 } }
I20260811 06:54:42.167166 14983 leader_election.cc:302] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1bc3fb3de094490b474f29613fc6169; no voters:
I20260811 06:54:42.167831 14983 leader_election.cc:288] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:42.167974 14992 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:42.170274 14983 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:42.174957 14992 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [term 1 LEADER]: Becoming Leader. State: Replica: b1bc3fb3de094490b474f29613fc6169, State: Running, Role: LEADER
I20260811 06:54:42.175738 14992 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bc3fb3de094490b474f29613fc6169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43073 } }
I20260811 06:54:42.178967 14993 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1bc3fb3de094490b474f29613fc6169" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bc3fb3de094490b474f29613fc6169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43073 } } }
I20260811 06:54:42.179437 14993 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:42.193318 15018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:42.193120 14995 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1bc3fb3de094490b474f29613fc6169. Latest consensus state: current_term: 1 leader_uuid: "b1bc3fb3de094490b474f29613fc6169" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bc3fb3de094490b474f29613fc6169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43073 } } }
I20260811 06:54:42.193607 14995 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:42.198951 14988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:42.176485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41803 (local address 127.0.0.1:43073)
0811 06:54:42.176666 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:42.176672 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:42.183615 (+ 6943us) server_negotiation.cc:407] Connection header received
0811 06:54:42.183827 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:42.183832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:42.183925 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:42.184039 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:42.186278 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:42.187168 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:42.188490 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:42.188922 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:42.189046 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:42.191521 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:42.191529 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:42.191535 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:42.191576 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:42.195876 (+ 4300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:42.196765 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:42.196769 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:42.196771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:42.196887 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:42.197360 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:42.197364 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:42.197366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:42.197752 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:42.198012 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:42.198412 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 06:54:42.198601 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:54:42.199149 15018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:42.208508 15018 catalog_manager.cc:1347] Generated new cluster ID: fb6bd6f262f942a2958272de0057ae09
I20260811 06:54:42.208691 15018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:42.232713 15018 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:42.234083 15018 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:42.241508 15018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1bc3fb3de094490b474f29613fc6169: Generated new TSK 0
I20260811 06:54:42.242353 15018 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:42.260089 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 14883
I20260811 06:54:42.261459 14976 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:42.355010 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 14883
W20260811 06:54:42.379839 14853 connection.cc:535] client connection to 127.0.0.1:43073 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43073): Connection reset by peer (error 104)
2026-08-11T06:54:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2216 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:42 dist-test-slave-7lbf krb5kdc[15043](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:42 dist-test-slave-7lbf krb5kdc[15043](info): set up 2 sockets
Aug 11 06:54:42 dist-test-slave-7lbf krb5kdc[15043](info): commencing operation
krb5kdc: starting...
W20260811 06:54:43.609719 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.211s user 0.002s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:43 dist-test-slave-7lbf krb5kdc[15043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:54:43.920957 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40795
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:44.258118 15059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:44.258422 15059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:44.258569 15059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:44.265672 15059 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:44.265794 15059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:44.265882 15059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:44.265967 15059 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:44.266031 15059 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:44.275923 15059 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40795
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:44.277237 15059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:44.278551 15059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:44.289916 15067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:44.289978 15069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:44.290001 15073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:44.290967 15059 server_base.cc:1034] running on GCE node
I20260811 06:54:44.291661 15059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:44.292987 15059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:44.294183 15059 hybrid_clock.cc:648] HybridClock initialized: now 1786431284294141 us; error 31 us; skew 500 ppm
I20260811 06:54:44.294502 15059 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:44 dist-test-slave-7lbf krb5kdc[15043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431284, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:44.297461 15059 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:54:44.298902 15059 webserver.cc:460] Webserver started at http://127.0.0.1:37495/ using document root <none> and password file <none>
I20260811 06:54:44.299526 15059 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:44.299654 15059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:44.299958 15059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:44.302896 15059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "fdbaa001fc2142ff989f453e15a907c7"
format_stamp: "Formatted at 2026-08-11 06:54:44 on dist-test-slave-7lbf"
server_key: "12ebc5f8f0f7c1bb85080de5f1451bfc"
server_key_iv: "b6ce206e5e4bbaac89aca7d2f4162592"
server_key_version: "encryptionkey@0"
I20260811 06:54:44.303618 15059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "fdbaa001fc2142ff989f453e15a907c7"
format_stamp: "Formatted at 2026-08-11 06:54:44 on dist-test-slave-7lbf"
server_key: "12ebc5f8f0f7c1bb85080de5f1451bfc"
server_key_iv: "b6ce206e5e4bbaac89aca7d2f4162592"
server_key_version: "encryptionkey@0"
I20260811 06:54:44.308504 15059 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 06:54:44.311872 15083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:44.313143 15059 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 06:54:44.313292 15059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "fdbaa001fc2142ff989f453e15a907c7"
format_stamp: "Formatted at 2026-08-11 06:54:44 on dist-test-slave-7lbf"
server_key: "12ebc5f8f0f7c1bb85080de5f1451bfc"
server_key_iv: "b6ce206e5e4bbaac89aca7d2f4162592"
server_key_version: "encryptionkey@0"
I20260811 06:54:44.313467 15059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:44.334645 15059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:44.338795 15059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:44.339082 15059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:44.358049 15059 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40795
I20260811 06:54:44.358083 15178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40795 every 8 connection(s)
I20260811 06:54:44.359369 15059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:44.361622 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 15059
I20260811 06:54:44.361792 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:44.362345 12868 external_mini_cluster.cc:1428] Setting key 38c1efd2daddeb91af2227cfdb6f31d6
I20260811 06:54:44.363587 15180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:44.375399 15187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:44.364132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37923 (local address 127.0.0.1:40795)
0811 06:54:44.364868 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:44.364879 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:44.364920 (+ 41us) server_negotiation.cc:407] Connection header received
0811 06:54:44.366553 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:44.366576 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:44.366951 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:44.367294 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:44.367882 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:44.369219 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:44.371023 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:44.371663 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:44.371814 (+ 151us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:44.373103 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:44.373115 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:44.373128 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:44.373718 (+ 590us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:44.373798 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:44.373824 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:44.373953 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:44.374232 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 06:54:44.374422 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":326,"threads_started":1}
I20260811 06:54:44.376959 15180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7: Bootstrap starting.
I20260811 06:54:44.379354 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:54:44.380225 15180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:44.381232 15180 log.cc:824] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:44.384223 15180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7: No bootstrap required, opened a new log
I20260811 06:54:44.389919 15187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:44.383663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43771 (local address 127.0.0.1:40795)
0811 06:54:44.383838 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:44.383844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:44.384266 (+ 422us) server_negotiation.cc:407] Connection header received
0811 06:54:44.384431 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:44.384435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:44.384501 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:44.384579 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:44.385092 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:44.385918 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:44.387266 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:44.387726 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:44.387845 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:44.388981 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:44.388986 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:44.388990 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:44.389006 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:44.389044 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:44.389063 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:44.389173 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:44.389609 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 06:54:44.389662 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 06:54:44.393090 15180 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbaa001fc2142ff989f453e15a907c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40795 } }
I20260811 06:54:44.393440 15180 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:44.393560 15180 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdbaa001fc2142ff989f453e15a907c7, State: Initialized, Role: FOLLOWER
I20260811 06:54:44.394150 15180 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbaa001fc2142ff989f453e15a907c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40795 } }
I20260811 06:54:44.394380 15180 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:44.394513 15180 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:44.394666 15180 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:44.397230 15180 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbaa001fc2142ff989f453e15a907c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40795 } }
I20260811 06:54:44.397765 15180 leader_election.cc:302] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdbaa001fc2142ff989f453e15a907c7; no voters:
I20260811 06:54:44.398339 15180 leader_election.cc:288] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:44.398492 15195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:44.399614 15195 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [term 1 LEADER]: Becoming Leader. State: Replica: fdbaa001fc2142ff989f453e15a907c7, State: Running, Role: LEADER
I20260811 06:54:44.400264 15195 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbaa001fc2142ff989f453e15a907c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40795 } }
I20260811 06:54:44.400533 15180 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:44.410126 15197 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdbaa001fc2142ff989f453e15a907c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbaa001fc2142ff989f453e15a907c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40795 } } }
I20260811 06:54:44.410768 15197 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:44.410673 15199 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdbaa001fc2142ff989f453e15a907c7. Latest consensus state: current_term: 1 leader_uuid: "fdbaa001fc2142ff989f453e15a907c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdbaa001fc2142ff989f453e15a907c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40795 } } }
I20260811 06:54:44.410950 15199 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:44.414129 15211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:44.418761 15211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:44.426811 15211 catalog_manager.cc:1347] Generated new cluster ID: 74dda981302b4ad4b4e36ed0e9446ca4
I20260811 06:54:44.426918 15211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:44.454779 15211 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:44.456404 15211 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:44.462018 15211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdbaa001fc2142ff989f453e15a907c7: Generated new TSK 0
I20260811 06:54:44.462759 15211 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:44.471140 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15059
W20260811 06:54:44.472201 15171 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:37923
W20260811 06:54:44.472889 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15059: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:54:44.473061 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 15059
W20260811 06:54:44.502506 15040 connection.cc:535] client connection to 127.0.0.1:40795 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40795): Connection reset by peer (error 104)
2026-08-11T06:54:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2122 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:44 dist-test-slave-7lbf krb5kdc[15231](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:44 dist-test-slave-7lbf krb5kdc[15231](info): set up 2 sockets
Aug 11 06:54:44 dist-test-slave-7lbf krb5kdc[15231](info): commencing operation
krb5kdc: starting...
W20260811 06:54:45.730588 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.005s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:45 dist-test-slave-7lbf krb5kdc[15231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:54:46.028012 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42805
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42805
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:46.359995 15248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:46.360275 15248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:46.360414 15248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:46.367461 15248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:46.367585 15248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:46.367659 15248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:46.367739 15248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:46.367796 15248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:46.377385 15248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42805
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:46.378670 15248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:46.379966 15248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:46.391441 15255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:46.391500 15256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:46.391542 15259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:46.392442 15248 server_base.cc:1034] running on GCE node
I20260811 06:54:46.393237 15248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:46.394655 15248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:46.395884 15248 hybrid_clock.cc:648] HybridClock initialized: now 1786431286395843 us; error 25 us; skew 500 ppm
I20260811 06:54:46.396227 15248 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:46 dist-test-slave-7lbf krb5kdc[15231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431286, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:46.399328 15248 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:54:46.400708 15248 webserver.cc:460] Webserver started at http://127.0.0.1:34905/ using document root <none> and password file <none>
I20260811 06:54:46.401461 15248 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:46.401613 15248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:46.401950 15248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:46.404883 15248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "a7a8a413cdb647a289b36d31c481e3f9"
format_stamp: "Formatted at 2026-08-11 06:54:46 on dist-test-slave-7lbf"
server_key: "40138edf6afe1ddb1ced99a4b959f7e1"
server_key_iv: "23b0318c437de2855c5240f84512f626"
server_key_version: "encryptionkey@0"
I20260811 06:54:46.405771 15248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "a7a8a413cdb647a289b36d31c481e3f9"
format_stamp: "Formatted at 2026-08-11 06:54:46 on dist-test-slave-7lbf"
server_key: "40138edf6afe1ddb1ced99a4b959f7e1"
server_key_iv: "23b0318c437de2855c5240f84512f626"
server_key_version: "encryptionkey@0"
I20260811 06:54:46.410873 15248 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 06:54:46.414312 15268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:46.415545 15248 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:54:46.415700 15248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "a7a8a413cdb647a289b36d31c481e3f9"
format_stamp: "Formatted at 2026-08-11 06:54:46 on dist-test-slave-7lbf"
server_key: "40138edf6afe1ddb1ced99a4b959f7e1"
server_key_iv: "23b0318c437de2855c5240f84512f626"
server_key_version: "encryptionkey@0"
I20260811 06:54:46.415891 15248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:46.421860 15248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:46.425621 15248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:46.425904 15248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:46.443181 15248 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42805
I20260811 06:54:46.443222 15352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42805 every 8 connection(s)
I20260811 06:54:46.444587 15248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:46.446177 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 15248
I20260811 06:54:46.446378 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:46.446826 12868 external_mini_cluster.cc:1428] Setting key 6a39a4f540d437f136c7b38e9373ddcb
I20260811 06:54:46.448760 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:46.454385 15359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:46.448505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57303 (local address 127.0.0.1:42805)
0811 06:54:46.449281 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:46.449301 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:46.449342 (+ 41us) server_negotiation.cc:407] Connection header received
0811 06:54:46.451005 (+ 1663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:46.451028 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:46.451371 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:46.451708 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:46.452786 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:46.452794 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:46.452807 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:46.452849 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:46.452925 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:46.452948 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:46.453124 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:46.453236 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 06:54:46.453434 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":347,"threads_started":1}
I20260811 06:54:46.457947 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:54:46.461193 15353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9: Bootstrap starting.
I20260811 06:54:46.465035 15353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:46.465598 15359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:46.463120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35397 (local address 127.0.0.1:42805)
0811 06:54:46.463309 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:46.463314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:46.463652 (+ 338us) server_negotiation.cc:407] Connection header received
0811 06:54:46.463833 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:46.463837 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:46.463883 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:46.463959 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:46.464891 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:46.464895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:46.464899 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:46.464912 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:46.464953 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:46.464967 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:46.465051 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:46.465234 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 06:54:46.465279 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 06:54:46.466374 15353 log.cc:824] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:46.469024 15353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9: No bootstrap required, opened a new log
I20260811 06:54:46.476173 15353 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a8a413cdb647a289b36d31c481e3f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42805 } }
I20260811 06:54:46.476523 15353 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:46.476598 15353 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7a8a413cdb647a289b36d31c481e3f9, State: Initialized, Role: FOLLOWER
I20260811 06:54:46.477087 15353 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a8a413cdb647a289b36d31c481e3f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42805 } }
I20260811 06:54:46.477290 15353 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:46.477423 15353 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:46.477591 15353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:46.479871 15353 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a8a413cdb647a289b36d31c481e3f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42805 } }
I20260811 06:54:46.480336 15353 leader_election.cc:302] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7a8a413cdb647a289b36d31c481e3f9; no voters:
I20260811 06:54:46.480906 15353 leader_election.cc:288] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:46.481017 15371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:46.481639 15371 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [term 1 LEADER]: Becoming Leader. State: Replica: a7a8a413cdb647a289b36d31c481e3f9, State: Running, Role: LEADER
I20260811 06:54:46.482215 15371 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a8a413cdb647a289b36d31c481e3f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42805 } }
I20260811 06:54:46.482879 15353 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:46.485554 15372 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7a8a413cdb647a289b36d31c481e3f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a8a413cdb647a289b36d31c481e3f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42805 } } }
I20260811 06:54:46.485641 15374 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7a8a413cdb647a289b36d31c481e3f9. Latest consensus state: current_term: 1 leader_uuid: "a7a8a413cdb647a289b36d31c481e3f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a8a413cdb647a289b36d31c481e3f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42805 } } }
I20260811 06:54:46.485998 15374 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:46.486002 15372 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:46.488336 15383 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:46.493300 15383 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:46.502274 15383 catalog_manager.cc:1347] Generated new cluster ID: 59cc4200eca148978268034dd2ea70b4
I20260811 06:54:46.502377 15383 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:46.512686 15383 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:46.513139 15383 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:46.527371 15383 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7a8a413cdb647a289b36d31c481e3f9: Generated new TSK 0
I20260811 06:54:46.528355 15383 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:46.542054 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15248
W20260811 06:54:46.543310 15344 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57303
W20260811 06:54:46.544044 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15248: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:54:46.544198 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 15248
2026-08-11T06:54:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2067 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:46 dist-test-slave-7lbf krb5kdc[15403](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:46 dist-test-slave-7lbf krb5kdc[15403](info): set up 2 sockets
Aug 11 06:54:46 dist-test-slave-7lbf krb5kdc[15403](info): commencing operation
krb5kdc: starting...
W20260811 06:54:47.801414 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.003s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:47 dist-test-slave-7lbf krb5kdc[15403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:54:48.092600 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35731
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:48.587421 15427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:48.587924 15427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:48.588183 15427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:48.600369 15427 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:48.600555 15427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:48.600625 15427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:48.600723 15427 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:48.600793 15427 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:48.617267 15427 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:48.619540 15427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:48.621824 15427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:48.642028 15435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:48.642028 15437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:48.642168 15434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:48.643838 15427 server_base.cc:1034] running on GCE node
I20260811 06:54:48.645219 15427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:48.648100 15427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:48.649473 15427 hybrid_clock.cc:648] HybridClock initialized: now 1786431288649400 us; error 71 us; skew 500 ppm
I20260811 06:54:48.650207 15427 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:48 dist-test-slave-7lbf krb5kdc[15403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431288, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:48.655905 15427 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:54:48.658641 15427 webserver.cc:460] Webserver started at http://127.0.0.1:41933/ using document root <none> and password file <none>
I20260811 06:54:48.659752 15427 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:48.659994 15427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:48.660502 15427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:48.666014 15427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "70b1d733a0774525b71bd6b707f8bdc5"
format_stamp: "Formatted at 2026-08-11 06:54:48 on dist-test-slave-7lbf"
server_key: "571074445fa07f934089829a41291532"
server_key_iv: "6bf8d90c1de4185e699ce390fbb05c80"
server_key_version: "encryptionkey@0"
I20260811 06:54:48.667439 15427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "70b1d733a0774525b71bd6b707f8bdc5"
format_stamp: "Formatted at 2026-08-11 06:54:48 on dist-test-slave-7lbf"
server_key: "571074445fa07f934089829a41291532"
server_key_iv: "6bf8d90c1de4185e699ce390fbb05c80"
server_key_version: "encryptionkey@0"
I20260811 06:54:48.677946 15427 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.006s sys 0.005s
I20260811 06:54:48.684798 15445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:48.687255 15427 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 06:54:48.687568 15427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "70b1d733a0774525b71bd6b707f8bdc5"
format_stamp: "Formatted at 2026-08-11 06:54:48 on dist-test-slave-7lbf"
server_key: "571074445fa07f934089829a41291532"
server_key_iv: "6bf8d90c1de4185e699ce390fbb05c80"
server_key_version: "encryptionkey@0"
I20260811 06:54:48.687888 15427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:48.722805 15427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:48.730403 15427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:48.730924 15427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:48.762976 15427 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35731
I20260811 06:54:48.763044 15537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35731 every 8 connection(s)
I20260811 06:54:48.765458 15427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:48.772121 15539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:48.772948 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 15427
I20260811 06:54:48.773216 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:48.774065 12868 external_mini_cluster.cc:1428] Setting key 7d3a5e6e758a55b96aa3a8b06b033f18
I20260811 06:54:48.800670 15539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5: Bootstrap starting.
Aug 11 06:54:48 dist-test-slave-7lbf krb5kdc[15403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 06:54:48.806254 15539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:48.808043 15539 log.cc:824] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:48.813181 15539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5: No bootstrap required, opened a new log
I20260811 06:54:48.821444 15542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:48.776961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59137 (local address 127.0.0.1:35731)
0811 06:54:48.778531 (+ 1570us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:48.778573 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:48.778678 (+ 105us) server_negotiation.cc:407] Connection header received
0811 06:54:48.783897 (+ 5219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:48.783965 (+ 68us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:48.785064 (+ 1099us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:48.786025 (+ 961us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:48.790208 (+ 4183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:48.793796 (+ 3588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:48.797144 (+ 3348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:48.799320 (+ 2176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:48.799728 (+ 408us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:48.807171 (+ 7443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:48.807182 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:48.807224 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:48.807310 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:48.812403 (+ 5093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:48.813764 (+ 1361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:48.813785 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:48.813817 (+ 32us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:48.814259 (+ 442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:48.814878 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:48.814883 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:48.814887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:48.816462 (+ 1575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:48.817019 (+ 557us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:48.817688 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 06:54:48.818607 (+ 919us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1096,"thread_start_us":609,"threads_started":1}
I20260811 06:54:48.827703 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:54:48.830591 15539 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b1d733a0774525b71bd6b707f8bdc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } }
I20260811 06:54:48.831219 15539 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:48.831385 15539 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70b1d733a0774525b71bd6b707f8bdc5, State: Initialized, Role: FOLLOWER
I20260811 06:54:48.832832 15539 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b1d733a0774525b71bd6b707f8bdc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } }
I20260811 06:54:48.833400 15539 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:48.833676 15539 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:48.833950 15539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:48.838572 15539 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b1d733a0774525b71bd6b707f8bdc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } }
I20260811 06:54:48.839350 15539 leader_election.cc:302] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70b1d733a0774525b71bd6b707f8bdc5; no voters:
I20260811 06:54:48.840302 15539 leader_election.cc:288] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:48.840548 15557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:48.842314 15557 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [term 1 LEADER]: Becoming Leader. State: Replica: 70b1d733a0774525b71bd6b707f8bdc5, State: Running, Role: LEADER
I20260811 06:54:48.843554 15557 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b1d733a0774525b71bd6b707f8bdc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } }
I20260811 06:54:48.843995 15539 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:48.849006 15561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70b1d733a0774525b71bd6b707f8bdc5. Latest consensus state: current_term: 1 leader_uuid: "70b1d733a0774525b71bd6b707f8bdc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b1d733a0774525b71bd6b707f8bdc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } } }
I20260811 06:54:48.849772 15561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:48.850739 15558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70b1d733a0774525b71bd6b707f8bdc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b1d733a0774525b71bd6b707f8bdc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35731 } } }
I20260811 06:54:48.851359 15558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:48.868345 15542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:48.835101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44497 (local address 127.0.0.1:35731)
0811 06:54:48.835332 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:48.835347 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:48.836372 (+ 1025us) server_negotiation.cc:407] Connection header received
0811 06:54:48.836700 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:48.836706 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:48.836821 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:48.836977 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:48.839570 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:48.841283 (+ 1713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:48.844893 (+ 3610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:48.846278 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:48.847932 (+ 1654us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:48.853018 (+ 5086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:48.853038 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:48.853055 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:48.853158 (+ 103us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:48.860040 (+ 6882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:48.861897 (+ 1857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:48.861914 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:48.861919 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:48.862205 (+ 286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:48.863139 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:48.863156 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:48.863180 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:48.864063 (+ 883us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:48.866732 (+ 2669us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:48.867121 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 06:54:48.867548 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 06:54:48.876310 15566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:48.886955 15566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:48.902163 15566 catalog_manager.cc:1347] Generated new cluster ID: 9feefaa226e24a9f9d43212aedda5341
I20260811 06:54:48.902384 15566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:48.915594 15566 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:48.918952 15566 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:48.930950 15566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70b1d733a0774525b71bd6b707f8bdc5: Generated new TSK 0
I20260811 06:54:48.932229 15566 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:48.945811 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15427
I20260811 06:54:48.947835 15532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:49.076205 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 15427
2026-08-11T06:54:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2547 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:49 dist-test-slave-7lbf krb5kdc[15598](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:49 dist-test-slave-7lbf krb5kdc[15598](info): set up 2 sockets
Aug 11 06:54:49 dist-test-slave-7lbf krb5kdc[15598](info): commencing operation
krb5kdc: starting...
W20260811 06:54:50.837568 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.698s user 0.000s sys 0.072s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:51 dist-test-slave-7lbf krb5kdc[15598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:54:51.145255 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37941
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:51.480001 15615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:51.480309 15615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:51.480463 15615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:51.487860 15615 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:51.487975 15615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:51.488050 15615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:51.488134 15615 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:51.488193 15615 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:51.498188 15615 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:51.499462 15615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:51.500790 15615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:51.512115 15623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:51.512084 15624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:51.512008 15627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:51.513245 15615 server_base.cc:1034] running on GCE node
I20260811 06:54:51.514050 15615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:51.515396 15615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:51.516594 15615 hybrid_clock.cc:648] HybridClock initialized: now 1786431291516547 us; error 36 us; skew 500 ppm
I20260811 06:54:51.516925 15615 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:51 dist-test-slave-7lbf krb5kdc[15598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431291, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:51.526590 15615 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:54:51.529120 15615 webserver.cc:460] Webserver started at http://127.0.0.1:34191/ using document root <none> and password file <none>
I20260811 06:54:51.529846 15615 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:51.529969 15615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:51.530269 15615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:51.533339 15615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "10711200b0ac492a8aac73bf4b2a77ee"
format_stamp: "Formatted at 2026-08-11 06:54:51 on dist-test-slave-7lbf"
server_key: "a714ae01a013e6cdbabd04ad961ef9c7"
server_key_iv: "475dcf9675a51dbbd3395ec010a121c8"
server_key_version: "encryptionkey@0"
I20260811 06:54:51.534222 15615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "10711200b0ac492a8aac73bf4b2a77ee"
format_stamp: "Formatted at 2026-08-11 06:54:51 on dist-test-slave-7lbf"
server_key: "a714ae01a013e6cdbabd04ad961ef9c7"
server_key_iv: "475dcf9675a51dbbd3395ec010a121c8"
server_key_version: "encryptionkey@0"
I20260811 06:54:51.539556 15615 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 06:54:51.543236 15638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:51.544636 15615 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 06:54:51.544806 15615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "10711200b0ac492a8aac73bf4b2a77ee"
format_stamp: "Formatted at 2026-08-11 06:54:51 on dist-test-slave-7lbf"
server_key: "a714ae01a013e6cdbabd04ad961ef9c7"
server_key_iv: "475dcf9675a51dbbd3395ec010a121c8"
server_key_version: "encryptionkey@0"
I20260811 06:54:51.545002 15615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:51.567951 15615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:51.571760 15615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:51.572026 15615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:51.589440 15615 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37941
I20260811 06:54:51.589473 15720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37941 every 8 connection(s)
I20260811 06:54:51.590822 15615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:51.594444 15725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:51.594970 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 15615
I20260811 06:54:51.595160 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:51.595737 12868 external_mini_cluster.cc:1428] Setting key 8d3e842b8a39cce790972e87bc34d3ed
I20260811 06:54:51.607764 15725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee: Bootstrap starting.
I20260811 06:54:51.608924 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:51.597486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35075 (local address 127.0.0.1:37941)
0811 06:54:51.598288 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:51.598300 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:51.598354 (+ 54us) server_negotiation.cc:407] Connection header received
0811 06:54:51.600480 (+ 2126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:51.600506 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:51.600891 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:51.601206 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:51.601824 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:51.603064 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:51.604913 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:51.605636 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:51.605762 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:51.606909 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:51.606916 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:51.606929 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:51.607429 (+ 500us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:51.607499 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:51.607522 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:51.607607 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:51.607819 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 06:54:51.608036 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":355,"threads_started":1}
I20260811 06:54:51.610960 15725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:51.612179 15725 log.cc:824] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:51.612355 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:54:51.615200 15725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee: No bootstrap required, opened a new log
I20260811 06:54:51.623411 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:51.617321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54737 (local address 127.0.0.1:37941)
0811 06:54:51.617455 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:51.617459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:51.617844 (+ 385us) server_negotiation.cc:407] Connection header received
0811 06:54:51.618006 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:51.618012 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:51.618068 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:51.618147 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:51.618668 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:51.619340 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:51.621146 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:51.621647 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:51.621744 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:51.622781 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:51.622786 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:51.622789 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:51.622804 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:51.622841 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:51.622855 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:51.622922 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:51.623054 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 06:54:51.623122 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 06:54:51.624820 15725 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10711200b0ac492a8aac73bf4b2a77ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37941 } }
I20260811 06:54:51.625161 15725 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:51.625257 15725 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10711200b0ac492a8aac73bf4b2a77ee, State: Initialized, Role: FOLLOWER
I20260811 06:54:51.625828 15725 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10711200b0ac492a8aac73bf4b2a77ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37941 } }
I20260811 06:54:51.626052 15725 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:51.626183 15725 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:51.626336 15725 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:51.628562 15725 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10711200b0ac492a8aac73bf4b2a77ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37941 } }
I20260811 06:54:51.629046 15725 leader_election.cc:302] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10711200b0ac492a8aac73bf4b2a77ee; no voters:
I20260811 06:54:51.629621 15725 leader_election.cc:288] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:51.629747 15736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:51.630416 15736 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [term 1 LEADER]: Becoming Leader. State: Replica: 10711200b0ac492a8aac73bf4b2a77ee, State: Running, Role: LEADER
I20260811 06:54:51.630990 15736 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10711200b0ac492a8aac73bf4b2a77ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37941 } }
I20260811 06:54:51.631783 15725 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:51.633876 15742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10711200b0ac492a8aac73bf4b2a77ee. Latest consensus state: current_term: 1 leader_uuid: "10711200b0ac492a8aac73bf4b2a77ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10711200b0ac492a8aac73bf4b2a77ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37941 } } }
I20260811 06:54:51.633898 15738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10711200b0ac492a8aac73bf4b2a77ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10711200b0ac492a8aac73bf4b2a77ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37941 } } }
I20260811 06:54:51.634351 15742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:51.634351 15738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee [sys.catalog]: This master's current role is: LEADER
W20260811 06:54:51.642331 15767 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:54:51.642445 15767 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:54:51.642580 15751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:51.644289 15751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:51.652143 15751 catalog_manager.cc:1347] Generated new cluster ID: af228656101b482f921c36cc2c49d2e4
I20260811 06:54:51.652254 15751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:51.663975 15751 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:51.665266 15751 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:51.670153 15751 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10711200b0ac492a8aac73bf4b2a77ee: Generated new TSK 0
I20260811 06:54:51.670930 15751 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:51.677696 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15615
W20260811 06:54:51.678825 15716 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35075
W20260811 06:54:51.679623 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15615: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:54:51.679762 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 15615
2026-08-11T06:54:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2585 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:51 dist-test-slave-7lbf krb5kdc[15779](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:51 dist-test-slave-7lbf krb5kdc[15779](info): set up 2 sockets
Aug 11 06:54:51 dist-test-slave-7lbf krb5kdc[15779](info): commencing operation
krb5kdc: starting...
W20260811 06:54:52.929872 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:53 dist-test-slave-7lbf krb5kdc[15779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:54:53.246130 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33395
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:53.587690 15803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:53.587953 15803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:53.588086 15803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:53.595028 15803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:53.595129 15803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:53.595206 15803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:53.595283 15803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:53.595341 15803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:53.604729 15803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:53.605952 15803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:53.607175 15803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:53.618209 15809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:53.618175 15810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:53.618570 15814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:53.618953 15803 server_base.cc:1034] running on GCE node
I20260811 06:54:53.619679 15803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:53.620981 15803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:53.622187 15803 hybrid_clock.cc:648] HybridClock initialized: now 1786431293622132 us; error 46 us; skew 500 ppm
I20260811 06:54:53.622509 15803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:53 dist-test-slave-7lbf krb5kdc[15779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431293, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:53.625504 15803 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:54:53.626897 15803 webserver.cc:460] Webserver started at http://127.0.0.1:35061/ using document root <none> and password file <none>
I20260811 06:54:53.627537 15803 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:53.627658 15803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:53.627936 15803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:53.630954 15803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "049ce87337c94d0aaf7f805c37b50d7b"
format_stamp: "Formatted at 2026-08-11 06:54:53 on dist-test-slave-7lbf"
server_key: "a8c2462e055a740c336c5aa4936d99be"
server_key_iv: "2e502f25b2af7c01eee7a1d8254881e3"
server_key_version: "encryptionkey@0"
I20260811 06:54:53.631752 15803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "049ce87337c94d0aaf7f805c37b50d7b"
format_stamp: "Formatted at 2026-08-11 06:54:53 on dist-test-slave-7lbf"
server_key: "a8c2462e055a740c336c5aa4936d99be"
server_key_iv: "2e502f25b2af7c01eee7a1d8254881e3"
server_key_version: "encryptionkey@0"
I20260811 06:54:53.636951 15803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 06:54:53.640460 15832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:53.641855 15803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:54:53.642030 15803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "049ce87337c94d0aaf7f805c37b50d7b"
format_stamp: "Formatted at 2026-08-11 06:54:53 on dist-test-slave-7lbf"
server_key: "a8c2462e055a740c336c5aa4936d99be"
server_key_iv: "2e502f25b2af7c01eee7a1d8254881e3"
server_key_version: "encryptionkey@0"
I20260811 06:54:53.642216 15803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:53.647948 15803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:53.651991 15803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:53.652257 15803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:53.669668 15803 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33395
I20260811 06:54:53.669687 15914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33395 every 8 connection(s)
I20260811 06:54:53.671047 15803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:53.674857 15915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:53.675279 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 15803
I20260811 06:54:53.675441 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:53.675879 12868 external_mini_cluster.cc:1428] Setting key 82e86c042f705e261946708eb947b394
I20260811 06:54:53.683885 15920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:53.677641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51973 (local address 127.0.0.1:33395)
0811 06:54:53.678472 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:53.678487 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:53.678529 (+ 42us) server_negotiation.cc:407] Connection header received
0811 06:54:53.680655 (+ 2126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:53.680682 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:53.681052 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:53.681386 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:53.682430 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:53.682437 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:53.682451 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:53.682464 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:53.682536 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:53.682555 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:53.682715 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:53.682820 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 06:54:53.682986 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":366,"threads_started":1}
I20260811 06:54:53.687233 15915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b: Bootstrap starting.
I20260811 06:54:53.687398 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:54:53.691008 15915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:53.692291 15915 log.cc:824] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:53.694825 15920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:53.692501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51687 (local address 127.0.0.1:33395)
0811 06:54:53.692677 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:53.692682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:53.693018 (+ 336us) server_negotiation.cc:407] Connection header received
0811 06:54:53.693188 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:53.693194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:53.693250 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:53.693336 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:53.694215 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:53.694224 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:53.694229 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:53.694247 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:53.694283 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:53.694298 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:53.694393 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:53.694508 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 06:54:53.694565 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 06:54:53.695207 15915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b: No bootstrap required, opened a new log
I20260811 06:54:53.703099 15915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "049ce87337c94d0aaf7f805c37b50d7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33395 } }
I20260811 06:54:53.703470 15915 raft_consensus.cc:374] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:53.703694 15915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 049ce87337c94d0aaf7f805c37b50d7b, State: Initialized, Role: FOLLOWER
I20260811 06:54:53.704243 15915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "049ce87337c94d0aaf7f805c37b50d7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33395 } }
I20260811 06:54:53.704465 15915 raft_consensus.cc:388] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:53.704568 15915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:53.704694 15915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:53.707098 15915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "049ce87337c94d0aaf7f805c37b50d7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33395 } }
I20260811 06:54:53.707648 15915 leader_election.cc:302] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 049ce87337c94d0aaf7f805c37b50d7b; no voters:
I20260811 06:54:53.708199 15915 leader_election.cc:288] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:53.708320 15933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:53.709224 15933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [term 1 LEADER]: Becoming Leader. State: Replica: 049ce87337c94d0aaf7f805c37b50d7b, State: Running, Role: LEADER
I20260811 06:54:53.709796 15933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "049ce87337c94d0aaf7f805c37b50d7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33395 } }
I20260811 06:54:53.710386 15915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:53.712638 15938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 049ce87337c94d0aaf7f805c37b50d7b. Latest consensus state: current_term: 1 leader_uuid: "049ce87337c94d0aaf7f805c37b50d7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "049ce87337c94d0aaf7f805c37b50d7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33395 } } }
I20260811 06:54:53.713471 15938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:53.717612 15934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "049ce87337c94d0aaf7f805c37b50d7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "049ce87337c94d0aaf7f805c37b50d7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33395 } } }
I20260811 06:54:53.717941 15934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:53.718935 15945 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:53.724633 15945 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:53.733619 15945 catalog_manager.cc:1347] Generated new cluster ID: ac6d44337dc2489c9be2577f86033f18
I20260811 06:54:53.733722 15945 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:53.765781 15945 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:53.766232 15945 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:53.773430 15945 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 049ce87337c94d0aaf7f805c37b50d7b: Generated new TSK 0
I20260811 06:54:53.774266 15945 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:53.785970 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15803
W20260811 06:54:53.787202 15906 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51973
W20260811 06:54:53.787842 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15803: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:54:53.787971 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 15803
2026-08-11T06:54:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2108 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:53 dist-test-slave-7lbf krb5kdc[15971](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:53 dist-test-slave-7lbf krb5kdc[15971](info): set up 2 sockets
Aug 11 06:54:53 dist-test-slave-7lbf krb5kdc[15971](info): commencing operation
krb5kdc: starting...
W20260811 06:54:55.042937 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:55 dist-test-slave-7lbf krb5kdc[15971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:54:55.363116 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41253
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41253
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:55.702920 15994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:55.703238 15994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:55.703382 15994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:55.710616 15994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:55.710726 15994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:55.710803 15994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:55.710891 15994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:55.710950 15994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:55.720674 15994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:55.722007 15994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:55.723325 15994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:55.734663 16000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:55.734735 16001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:55.734755 16004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:55.735962 15994 server_base.cc:1034] running on GCE node
I20260811 06:54:55.736797 15994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:55.738270 15994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:55.739514 15994 hybrid_clock.cc:648] HybridClock initialized: now 1786431295739462 us; error 40 us; skew 500 ppm
I20260811 06:54:55.739883 15994 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:55 dist-test-slave-7lbf krb5kdc[15971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431295, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:55.743157 15994 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:54:55.744639 15994 webserver.cc:460] Webserver started at http://127.0.0.1:38033/ using document root <none> and password file <none>
I20260811 06:54:55.745333 15994 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:55.745465 15994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:55.745802 15994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:55.748981 15994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "ea30a988180d4a438729036644fbaa4f"
format_stamp: "Formatted at 2026-08-11 06:54:55 on dist-test-slave-7lbf"
server_key: "5ce22a063a8c6747c4d735ff7d655ecc"
server_key_iv: "29c3a5da7be8b3fc568eae4df86a7f8c"
server_key_version: "encryptionkey@0"
I20260811 06:54:55.749868 15994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "ea30a988180d4a438729036644fbaa4f"
format_stamp: "Formatted at 2026-08-11 06:54:55 on dist-test-slave-7lbf"
server_key: "5ce22a063a8c6747c4d735ff7d655ecc"
server_key_iv: "29c3a5da7be8b3fc568eae4df86a7f8c"
server_key_version: "encryptionkey@0"
I20260811 06:54:55.755470 15994 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 06:54:55.759119 16016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:55.760432 15994 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 06:54:55.760615 15994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "ea30a988180d4a438729036644fbaa4f"
format_stamp: "Formatted at 2026-08-11 06:54:55 on dist-test-slave-7lbf"
server_key: "5ce22a063a8c6747c4d735ff7d655ecc"
server_key_iv: "29c3a5da7be8b3fc568eae4df86a7f8c"
server_key_version: "encryptionkey@0"
I20260811 06:54:55.760811 15994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:55.775986 15994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:55.780138 15994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:55.780455 15994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:55.799163 15994 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41253
I20260811 06:54:55.799186 16085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41253 every 8 connection(s)
I20260811 06:54:55.800618 15994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:55.803385 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 15994
I20260811 06:54:55.803581 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:55.804059 12868 external_mini_cluster.cc:1428] Setting key 76c8002c10a64d6deefd1fd5574f74e6
I20260811 06:54:55.804425 16086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:55.818351 16086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f: Bootstrap starting.
Aug 11 06:54:55 dist-test-slave-7lbf krb5kdc[15971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 06:54:55.821779 16086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:55.823170 16086 log.cc:824] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:55.826277 16086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f: No bootstrap required, opened a new log
I20260811 06:54:55.829171 16091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:55.805938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:40869 (local address 127.0.0.1:41253)
0811 06:54:55.806747 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:55.806763 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:55.806812 (+ 49us) server_negotiation.cc:407] Connection header received
0811 06:54:55.809151 (+ 2339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:55.809181 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:55.809707 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:55.810125 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:55.811663 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:55.813617 (+ 1954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:55.814994 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:55.816058 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:55.816243 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:55.820875 (+ 4632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:55.820886 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:55.820904 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:55.820948 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:55.824595 (+ 3647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:55.825403 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:55.825410 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:55.825418 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:55.825663 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:55.826146 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:55.826151 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:55.826154 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:55.826834 (+ 680us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:55.827144 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:55.827539 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 06:54:55.827873 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":331,"threads_started":1}
I20260811 06:54:55.833103 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:54:55.835294 16086 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea30a988180d4a438729036644fbaa4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41253 } }
I20260811 06:54:55.835634 16086 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:55.835733 16086 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea30a988180d4a438729036644fbaa4f, State: Initialized, Role: FOLLOWER
I20260811 06:54:55.836293 16086 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea30a988180d4a438729036644fbaa4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41253 } }
I20260811 06:54:55.836513 16086 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:55.836638 16086 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:55.836789 16086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:55.840004 16086 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea30a988180d4a438729036644fbaa4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41253 } }
I20260811 06:54:55.840543 16086 leader_election.cc:302] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea30a988180d4a438729036644fbaa4f; no voters:
I20260811 06:54:55.841142 16086 leader_election.cc:288] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:55.841262 16108 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:55.842902 16108 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [term 1 LEADER]: Becoming Leader. State: Replica: ea30a988180d4a438729036644fbaa4f, State: Running, Role: LEADER
I20260811 06:54:55.843498 16086 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:55.843532 16108 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea30a988180d4a438729036644fbaa4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41253 } }
I20260811 06:54:55.846576 16113 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea30a988180d4a438729036644fbaa4f. Latest consensus state: current_term: 1 leader_uuid: "ea30a988180d4a438729036644fbaa4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea30a988180d4a438729036644fbaa4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41253 } } }
I20260811 06:54:55.847563 16113 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:55.847203 16109 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea30a988180d4a438729036644fbaa4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea30a988180d4a438729036644fbaa4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41253 } } }
I20260811 06:54:55.848594 16109 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:55.849932 16124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:55.854380 16091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:55.837367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:54047 (local address 127.0.0.1:41253)
0811 06:54:55.837602 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:55.837608 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:55.837936 (+ 328us) server_negotiation.cc:407] Connection header received
0811 06:54:55.838136 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:55.838140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:55.838204 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:55.838288 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:55.840097 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:55.841013 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:55.842692 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:55.843383 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:55.843497 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:55.846388 (+ 2891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:55.846395 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:55.846400 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:54:55.846435 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:55.850043 (+ 3608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:55.851035 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:55.851041 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:55.851044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:55.851185 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:54:55.851744 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:54:55.851753 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:54:55.851757 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:54:55.852255 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:55.852578 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:55.853789 (+ 1211us) server_negotiation.cc:299] Negotiation successful
0811 06:54:55.853990 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 06:54:55.855381 16124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:55.865681 16124 catalog_manager.cc:1347] Generated new cluster ID: 0c992fd105e14a6c96fc9e28040056c0
I20260811 06:54:55.865796 16124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:55.879894 16124 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:55.881218 16124 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:55.895022 16124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea30a988180d4a438729036644fbaa4f: Generated new TSK 0
I20260811 06:54:55.895931 16124 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:55.911020 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 15994
I20260811 06:54:55.912281 16081 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:54:56.004050 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 15994
W20260811 06:54:56.028575 15967 connection.cc:535] client connection to 127.0.0.1:41253 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41253): Connection reset by peer (error 104)
2026-08-11T06:54:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2216 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:56 dist-test-slave-7lbf krb5kdc[16145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:56 dist-test-slave-7lbf krb5kdc[16145](info): set up 2 sockets
Aug 11 06:54:56 dist-test-slave-7lbf krb5kdc[16145](info): commencing operation
krb5kdc: starting...
W20260811 06:54:57.261420 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.003s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:57 dist-test-slave-7lbf krb5kdc[16145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:54:57.566383 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45615
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:54:57.902416 16167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:54:57.902724 16167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:54:57.902884 16167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:54:57.910068 16167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:54:57.910189 16167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:54:57.910264 16167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:54:57.910344 16167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:54:57.910404 16167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:54:57.920310 16167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:54:57.921598 16167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:54:57.922926 16167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:54:57.934481 16173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:57.934536 16174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:54:57.934435 16177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:54:57.935698 16167 server_base.cc:1034] running on GCE node
I20260811 06:54:57.936455 16167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:54:57.937901 16167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:54:57.939142 16167 hybrid_clock.cc:648] HybridClock initialized: now 1786431297939089 us; error 39 us; skew 500 ppm
I20260811 06:54:57.939520 16167 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:54:57 dist-test-slave-7lbf krb5kdc[16145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431297, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:54:57.945153 16167 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:54:57.946660 16167 webserver.cc:460] Webserver started at http://127.0.0.1:43297/ using document root <none> and password file <none>
I20260811 06:54:57.947311 16167 fs_manager.cc:359] Metadata directory not provided
I20260811 06:54:57.947429 16167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:54:57.947743 16167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:54:57.950683 16167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "baf1fde0932f4f9fb8712393e6990ba6"
format_stamp: "Formatted at 2026-08-11 06:54:57 on dist-test-slave-7lbf"
server_key: "b9daac7aece5a437025458a6b343111c"
server_key_iv: "391ee7a5e3a2d79cabf9c707547f3b32"
server_key_version: "encryptionkey@0"
I20260811 06:54:57.951484 16167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "baf1fde0932f4f9fb8712393e6990ba6"
format_stamp: "Formatted at 2026-08-11 06:54:57 on dist-test-slave-7lbf"
server_key: "b9daac7aece5a437025458a6b343111c"
server_key_iv: "391ee7a5e3a2d79cabf9c707547f3b32"
server_key_version: "encryptionkey@0"
I20260811 06:54:57.956405 16167 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 06:54:57.959802 16187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:54:57.961107 16167 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:54:57.961300 16167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "baf1fde0932f4f9fb8712393e6990ba6"
format_stamp: "Formatted at 2026-08-11 06:54:57 on dist-test-slave-7lbf"
server_key: "b9daac7aece5a437025458a6b343111c"
server_key_iv: "391ee7a5e3a2d79cabf9c707547f3b32"
server_key_version: "encryptionkey@0"
I20260811 06:54:57.961498 16167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:54:57.992015 16167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:54:57.996743 16167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:54:57.997049 16167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:54:58.015995 16167 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45615
I20260811 06:54:58.016018 16273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45615 every 8 connection(s)
I20260811 06:54:58.017472 16167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:54:58.021219 16274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:54:58.025424 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 16167
I20260811 06:54:58.025637 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:54:58.026125 12868 external_mini_cluster.cc:1428] Setting key 93f08650c6cf8e1d287e728c99693b36
I20260811 06:54:58.032342 16274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6: Bootstrap starting.
I20260811 06:54:58.035916 16274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6: Neither blocks nor log segments found. Creating new log.
I20260811 06:54:58.037328 16274 log.cc:824] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6: Log is configured to *not* fsync() on all Append() calls
I20260811 06:54:58.040340 16274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6: No bootstrap required, opened a new log
I20260811 06:54:58.040511 16279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:58.027973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:48877 (local address 127.0.0.1:45615)
0811 06:54:58.028802 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:58.028820 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:58.028870 (+ 50us) server_negotiation.cc:407] Connection header received
0811 06:54:58.030976 (+ 2106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:58.031001 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:58.031416 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:58.031754 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:58.032404 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:58.033880 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:58.035747 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:58.036681 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:58.036881 (+ 200us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:58.038345 (+ 1464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:58.038353 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:58.038368 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:58.038888 (+ 520us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:58.038963 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:58.038992 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:58.039131 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:58.039425 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 06:54:58.039588 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":363,"threads_started":1}
I20260811 06:54:58.044422 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:54:58.048750 16274 raft_consensus.cc:348] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf1fde0932f4f9fb8712393e6990ba6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } }
I20260811 06:54:58.049239 16274 raft_consensus.cc:374] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:54:58.049360 16274 raft_consensus.cc:729] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baf1fde0932f4f9fb8712393e6990ba6, State: Initialized, Role: FOLLOWER
I20260811 06:54:58.049974 16274 consensus_queue.cc:260] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf1fde0932f4f9fb8712393e6990ba6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } }
I20260811 06:54:58.050230 16274 raft_consensus.cc:388] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:54:58.050364 16274 raft_consensus.cc:482] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:54:58.050551 16274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:54:58.052711 16274 raft_consensus.cc:504] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf1fde0932f4f9fb8712393e6990ba6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } }
I20260811 06:54:58.053215 16274 leader_election.cc:302] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: baf1fde0932f4f9fb8712393e6990ba6; no voters:
I20260811 06:54:58.053824 16274 leader_election.cc:288] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:54:58.053963 16288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:54:58.055233 16279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:54:58.048664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:53795 (local address 127.0.0.1:45615)
0811 06:54:58.048859 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 06:54:58.048864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:54:58.049205 (+ 341us) server_negotiation.cc:407] Connection header received
0811 06:54:58.049400 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:54:58.049403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:54:58.049473 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:54:58.049598 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:54:58.050079 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:58.050992 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:58.052273 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:54:58.052746 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:54:58.052869 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:54:58.054135 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:54:58.054141 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:54:58.054145 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:54:58.054167 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:54:58.054232 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:54:58.054264 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:54:58.054390 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 06:54:58.054861 (+ 471us) server_negotiation.cc:299] Negotiation successful
0811 06:54:58.054915 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 06:54:58.056248 16274 sys_catalog.cc:564] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:54:58.060712 16288 raft_consensus.cc:686] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [term 1 LEADER]: Becoming Leader. State: Replica: baf1fde0932f4f9fb8712393e6990ba6, State: Running, Role: LEADER
I20260811 06:54:58.061321 16288 consensus_queue.cc:237] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf1fde0932f4f9fb8712393e6990ba6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } }
I20260811 06:54:58.063949 16289 sys_catalog.cc:455] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "baf1fde0932f4f9fb8712393e6990ba6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf1fde0932f4f9fb8712393e6990ba6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } } }
I20260811 06:54:58.064389 16289 sys_catalog.cc:458] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:58.063949 16290 sys_catalog.cc:455] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader baf1fde0932f4f9fb8712393e6990ba6. Latest consensus state: current_term: 1 leader_uuid: "baf1fde0932f4f9fb8712393e6990ba6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf1fde0932f4f9fb8712393e6990ba6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45615 } } }
I20260811 06:54:58.065454 16290 sys_catalog.cc:458] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6 [sys.catalog]: This master's current role is: LEADER
I20260811 06:54:58.065827 16306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:54:58.070814 16306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:54:58.078853 16306 catalog_manager.cc:1347] Generated new cluster ID: dacc44c2be2b4f2ab3501efed89f9661
I20260811 06:54:58.078972 16306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:54:58.090214 16306 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:54:58.091472 16306 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:54:58.097265 16306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P baf1fde0932f4f9fb8712393e6990ba6: Generated new TSK 0
I20260811 06:54:58.098095 16306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:54:58.111421 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16167
W20260811 06:54:58.112771 16263 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.224:48877
W20260811 06:54:58.113649 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16167: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:54:58.113799 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 16167
W20260811 06:54:58.137910 16143 connection.cc:535] client connection to 127.0.0.1:45615 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45615): Connection reset by peer (error 104)
2026-08-11T06:54:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2108 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:54:58 dist-test-slave-7lbf krb5kdc[16318](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:54:58 dist-test-slave-7lbf krb5kdc[16318](info): set up 2 sockets
Aug 11 06:54:58 dist-test-slave-7lbf krb5kdc[16318](info): commencing operation
krb5kdc: starting...
W20260811 06:54:59.393280 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.003s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:54:59 dist-test-slave-7lbf krb5kdc[16318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:54:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:54:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:54:59.716030 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33325
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:00.062704 16347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:00.063030 16347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:00.063140 16347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:00.070544 16347 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:00.070688 16347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:00.070749 16347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:00.070827 16347 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:00.070878 16347 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:00.081127 16347 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:00.082474 16347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:00.083859 16347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:00.096030 16358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:00.096088 16362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:00.096102 16364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:00.096891 16347 server_base.cc:1034] running on GCE node
I20260811 06:55:00.097784 16347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:00.099259 16347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:00.100451 16347 hybrid_clock.cc:648] HybridClock initialized: now 1786431300100397 us; error 52 us; skew 500 ppm
I20260811 06:55:00.100803 16347 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:00 dist-test-slave-7lbf krb5kdc[16318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431300, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:00.103955 16347 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:55:00.105443 16347 webserver.cc:460] Webserver started at http://127.0.0.1:37373/ using document root <none> and password file <none>
I20260811 06:55:00.106158 16347 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:00.106266 16347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:00.106544 16347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:00.109581 16347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "85396d88ac2345e6b5ed0cade5a31d58"
format_stamp: "Formatted at 2026-08-11 06:55:00 on dist-test-slave-7lbf"
server_key: "4956e50b2123cae955dea5feb9838622"
server_key_iv: "288f827169ac79c6655be74aa6c0a0d7"
server_key_version: "encryptionkey@0"
I20260811 06:55:00.110366 16347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "85396d88ac2345e6b5ed0cade5a31d58"
format_stamp: "Formatted at 2026-08-11 06:55:00 on dist-test-slave-7lbf"
server_key: "4956e50b2123cae955dea5feb9838622"
server_key_iv: "288f827169ac79c6655be74aa6c0a0d7"
server_key_version: "encryptionkey@0"
I20260811 06:55:00.115749 16347 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 06:55:00.119443 16375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:00.120813 16347 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 06:55:00.120959 16347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "85396d88ac2345e6b5ed0cade5a31d58"
format_stamp: "Formatted at 2026-08-11 06:55:00 on dist-test-slave-7lbf"
server_key: "4956e50b2123cae955dea5feb9838622"
server_key_iv: "288f827169ac79c6655be74aa6c0a0d7"
server_key_version: "encryptionkey@0"
I20260811 06:55:00.121135 16347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:00.126855 16347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:00.130820 16347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:00.131068 16347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:00.148638 16347 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33325
I20260811 06:55:00.148695 16450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33325 every 8 connection(s)
I20260811 06:55:00.150101 16347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:00.154084 16451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:00.156571 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 16347
I20260811 06:55:00.156735 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:00.157137 12868 external_mini_cluster.cc:1428] Setting key 637ccf210b09e0c37ff48fd493a9ac08
I20260811 06:55:00.166034 16455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:00.159015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:58251 (local address 127.0.0.1:33325)
0811 06:55:00.159830 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:00.159846 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:00.159899 (+ 53us) server_negotiation.cc:407] Connection header received
0811 06:55:00.162188 (+ 2289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:00.162218 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:00.162652 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:00.163119 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:00.164095 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:00.164103 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:00.164121 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:00.164141 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:00.164218 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:00.164243 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:00.164459 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:00.164599 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 06:55:00.164794 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":331,"threads_started":1}
I20260811 06:55:00.167348 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58: Bootstrap starting.
I20260811 06:55:00.169911 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:00.171088 16451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:00.172374 16451 log.cc:824] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:00.175477 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58: No bootstrap required, opened a new log
I20260811 06:55:00.177897 16455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:00.175317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:58231 (local address 127.0.0.1:33325)
0811 06:55:00.175512 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:00.175520 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:00.175940 (+ 420us) server_negotiation.cc:407] Connection header received
0811 06:55:00.176119 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:00.176124 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:00.176177 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:00.176257 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:00.177204 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:00.177209 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:00.177212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:00.177229 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:00.177267 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:00.177286 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:00.177406 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:00.177553 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 06:55:00.177619 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 06:55:00.183208 16451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85396d88ac2345e6b5ed0cade5a31d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33325 } }
I20260811 06:55:00.183609 16451 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:55:00.183703 16451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85396d88ac2345e6b5ed0cade5a31d58, State: Initialized, Role: FOLLOWER
I20260811 06:55:00.184265 16451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85396d88ac2345e6b5ed0cade5a31d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33325 } }
I20260811 06:55:00.184496 16451 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:55:00.184639 16451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:55:00.184816 16451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:00.187254 16451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85396d88ac2345e6b5ed0cade5a31d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33325 } }
I20260811 06:55:00.187733 16451 leader_election.cc:302] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85396d88ac2345e6b5ed0cade5a31d58; no voters:
I20260811 06:55:00.188268 16451 leader_election.cc:288] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:55:00.188400 16465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:00.189103 16465 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [term 1 LEADER]: Becoming Leader. State: Replica: 85396d88ac2345e6b5ed0cade5a31d58, State: Running, Role: LEADER
I20260811 06:55:00.189687 16465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85396d88ac2345e6b5ed0cade5a31d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33325 } }
I20260811 06:55:00.190428 16451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:00.192606 16467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85396d88ac2345e6b5ed0cade5a31d58. Latest consensus state: current_term: 1 leader_uuid: "85396d88ac2345e6b5ed0cade5a31d58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85396d88ac2345e6b5ed0cade5a31d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33325 } } }
I20260811 06:55:00.193012 16467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:00.193960 16466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85396d88ac2345e6b5ed0cade5a31d58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85396d88ac2345e6b5ed0cade5a31d58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33325 } } }
I20260811 06:55:00.194267 16466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:00.198100 16477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:00.203692 16477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:55:00.212636 16477 catalog_manager.cc:1347] Generated new cluster ID: a48b8b0f657c410ca1f906037e4bf54c
I20260811 06:55:00.212754 16477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:00.244022 16477 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:00.244570 16477 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:00.249830 16477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85396d88ac2345e6b5ed0cade5a31d58: Generated new TSK 0
I20260811 06:55:00.250658 16477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:00.257133 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16347
W20260811 06:55:00.258478 16444 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.224:58251
W20260811 06:55:00.259200 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16347: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:55:00.259336 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 16347
2026-08-11T06:55:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2152 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:00 dist-test-slave-7lbf krb5kdc[16498](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:00 dist-test-slave-7lbf krb5kdc[16498](info): set up 2 sockets
Aug 11 06:55:00 dist-test-slave-7lbf krb5kdc[16498](info): commencing operation
krb5kdc: starting...
W20260811 06:55:01.525207 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.007s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:01 dist-test-slave-7lbf krb5kdc[16498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:55:01.846953 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39405
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:02.186105 16518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:02.186420 16518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:02.186560 16518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:02.193804 16518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:02.193933 16518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:02.194017 16518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:02.194103 16518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:02.194171 16518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:02.204154 16518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39405
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:02.205550 16518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:02.206835 16518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:02.218492 16529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:02.218462 16536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:02.218679 16530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:02.219642 16518 server_base.cc:1034] running on GCE node
I20260811 06:55:02.220444 16518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:02.222015 16518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:02.223228 16518 hybrid_clock.cc:648] HybridClock initialized: now 1786431302223180 us; error 39 us; skew 500 ppm
I20260811 06:55:02.223587 16518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:02 dist-test-slave-7lbf krb5kdc[16498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431302, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:02.226717 16518 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:55:02.228181 16518 webserver.cc:460] Webserver started at http://127.0.0.1:42965/ using document root <none> and password file <none>
I20260811 06:55:02.228873 16518 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:02.228997 16518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:02.229297 16518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:02.232406 16518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "6fb124f9498a4b70834f8b401dcf95f7"
format_stamp: "Formatted at 2026-08-11 06:55:02 on dist-test-slave-7lbf"
server_key: "e033fd7a075450e0ea6f53ed967a7d52"
server_key_iv: "35e5216b6167f390c4f146eda6bc5637"
server_key_version: "encryptionkey@0"
I20260811 06:55:02.233199 16518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "6fb124f9498a4b70834f8b401dcf95f7"
format_stamp: "Formatted at 2026-08-11 06:55:02 on dist-test-slave-7lbf"
server_key: "e033fd7a075450e0ea6f53ed967a7d52"
server_key_iv: "35e5216b6167f390c4f146eda6bc5637"
server_key_version: "encryptionkey@0"
I20260811 06:55:02.238509 16518 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260811 06:55:02.242280 16548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:02.243685 16518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 06:55:02.243880 16518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "6fb124f9498a4b70834f8b401dcf95f7"
format_stamp: "Formatted at 2026-08-11 06:55:02 on dist-test-slave-7lbf"
server_key: "e033fd7a075450e0ea6f53ed967a7d52"
server_key_iv: "35e5216b6167f390c4f146eda6bc5637"
server_key_version: "encryptionkey@0"
I20260811 06:55:02.244110 16518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:02.260068 16518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:02.263967 16518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:02.264238 16518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:02.281741 16518 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39405
I20260811 06:55:02.281764 16625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39405 every 8 connection(s)
I20260811 06:55:02.283118 16518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:02.285310 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 16518
I20260811 06:55:02.285530 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:02.286101 12868 external_mini_cluster.cc:1428] Setting key ca19d7502d7e7acac04579c7bc505778
I20260811 06:55:02.287297 16627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:02.299070 16627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7: Bootstrap starting.
Aug 11 06:55:02 dist-test-slave-7lbf krb5kdc[16498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 06:55:02.302525 16627 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:02.303628 16627 log.cc:824] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:02.306452 16627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7: No bootstrap required, opened a new log
I20260811 06:55:02.307843 16634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:02.287981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:58957 (local address 127.0.0.1:39405)
0811 06:55:02.288750 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:02.288761 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:02.288802 (+ 41us) server_negotiation.cc:407] Connection header received
0811 06:55:02.290469 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:02.290491 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:02.290927 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:02.291298 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:02.292722 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:02.294113 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:02.295358 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:02.296045 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:02.296216 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:02.300589 (+ 4373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:02.300596 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:02.300610 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:02.300654 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:02.303793 (+ 3139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:02.304615 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:02.304621 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:02.304627 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:02.304807 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:02.305272 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:02.305276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:02.305278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:02.305822 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:02.306123 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:02.306594 (+ 471us) server_negotiation.cc:299] Negotiation successful
0811 06:55:02.306894 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":330,"threads_started":1}
I20260811 06:55:02.311596 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:02.314507 16627 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb124f9498a4b70834f8b401dcf95f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260811 06:55:02.314859 16627 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:55:02.314958 16627 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fb124f9498a4b70834f8b401dcf95f7, State: Initialized, Role: FOLLOWER
I20260811 06:55:02.315495 16627 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb124f9498a4b70834f8b401dcf95f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260811 06:55:02.315762 16627 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:55:02.315919 16627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:55:02.316200 16627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:02.319252 16627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb124f9498a4b70834f8b401dcf95f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260811 06:55:02.319737 16627 leader_election.cc:302] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fb124f9498a4b70834f8b401dcf95f7; no voters:
I20260811 06:55:02.320353 16627 leader_election.cc:288] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:55:02.320483 16646 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:02.321609 16646 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [term 1 LEADER]: Becoming Leader. State: Replica: 6fb124f9498a4b70834f8b401dcf95f7, State: Running, Role: LEADER
I20260811 06:55:02.322191 16646 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb124f9498a4b70834f8b401dcf95f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260811 06:55:02.322742 16627 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:02.325531 16647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fb124f9498a4b70834f8b401dcf95f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb124f9498a4b70834f8b401dcf95f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } } }
I20260811 06:55:02.327150 16647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:02.325802 16650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fb124f9498a4b70834f8b401dcf95f7. Latest consensus state: current_term: 1 leader_uuid: "6fb124f9498a4b70834f8b401dcf95f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fb124f9498a4b70834f8b401dcf95f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } } }
I20260811 06:55:02.327628 16650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:02.331094 16660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:02.334616 16634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:02.315870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:39793 (local address 127.0.0.1:39405)
0811 06:55:02.316062 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:02.316068 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:02.316462 (+ 394us) server_negotiation.cc:407] Connection header received
0811 06:55:02.316649 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:02.316652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:02.316709 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:02.316783 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:02.318618 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:02.319376 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:02.320713 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:02.321402 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:02.321491 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:02.324229 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:02.324237 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:02.324241 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:02.324292 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:02.330863 (+ 6571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:02.331943 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:02.331950 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:02.331953 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:02.332174 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:02.332863 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:02.332868 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:02.332872 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:02.333296 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:02.333643 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:02.334013 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 06:55:02.334196 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 06:55:02.336592 16660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:55:02.346047 16660 catalog_manager.cc:1347] Generated new cluster ID: 45cc49fe1953432ca8683279522df3c1
I20260811 06:55:02.346153 16660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:02.360476 16660 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:02.361904 16660 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:02.372305 16660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6fb124f9498a4b70834f8b401dcf95f7: Generated new TSK 0
I20260811 06:55:02.373216 16660 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:02.385016 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16518
I20260811 06:55:02.386294 16616 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:55:02.477562 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 16518
W20260811 06:55:02.500572 16495 connection.cc:535] client connection to 127.0.0.1:39405 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39405): Connection reset by peer (error 104)
2026-08-11T06:55:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2210 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:02 dist-test-slave-7lbf krb5kdc[16679](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:02 dist-test-slave-7lbf krb5kdc[16679](info): set up 2 sockets
Aug 11 06:55:02 dist-test-slave-7lbf krb5kdc[16679](info): commencing operation
krb5kdc: starting...
W20260811 06:55:03.731468 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:03 dist-test-slave-7lbf krb5kdc[16679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431303, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:55:04.052484 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41939
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41939
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:04.393147 16701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:04.393461 16701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:04.393622 16701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:04.400893 16701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:04.401036 16701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:04.401116 16701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:04.401216 16701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:04.401273 16701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:04.411387 16701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41939
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:04.412727 16701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:04.414131 16701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:04.426156 16715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:04.426689 16711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:04.426972 16706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:04.427335 16701 server_base.cc:1034] running on GCE node
I20260811 06:55:04.428071 16701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:04.429469 16701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:04.430703 16701 hybrid_clock.cc:648] HybridClock initialized: now 1786431304430653 us; error 38 us; skew 500 ppm
I20260811 06:55:04.431059 16701 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:04 dist-test-slave-7lbf krb5kdc[16679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431304, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:04.437134 16701 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:55:04.438714 16701 webserver.cc:460] Webserver started at http://127.0.0.1:36573/ using document root <none> and password file <none>
I20260811 06:55:04.439412 16701 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:04.439556 16701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:04.439862 16701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:04.442946 16701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "66bce7de224f4b9cbdabaf635b2e2640"
format_stamp: "Formatted at 2026-08-11 06:55:04 on dist-test-slave-7lbf"
server_key: "220e36a2dbcdf98c81df6e41ae447475"
server_key_iv: "427dd23ffa3054cf13426c5f1a445c8d"
server_key_version: "encryptionkey@0"
I20260811 06:55:04.443706 16701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "66bce7de224f4b9cbdabaf635b2e2640"
format_stamp: "Formatted at 2026-08-11 06:55:04 on dist-test-slave-7lbf"
server_key: "220e36a2dbcdf98c81df6e41ae447475"
server_key_iv: "427dd23ffa3054cf13426c5f1a445c8d"
server_key_version: "encryptionkey@0"
I20260811 06:55:04.448982 16701 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 06:55:04.452526 16728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:04.453881 16701 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:55:04.454044 16701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "66bce7de224f4b9cbdabaf635b2e2640"
format_stamp: "Formatted at 2026-08-11 06:55:04 on dist-test-slave-7lbf"
server_key: "220e36a2dbcdf98c81df6e41ae447475"
server_key_iv: "427dd23ffa3054cf13426c5f1a445c8d"
server_key_version: "encryptionkey@0"
I20260811 06:55:04.454221 16701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:04.468652 16701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:04.472673 16701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:04.472939 16701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:04.490674 16701 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41939
I20260811 06:55:04.490696 16805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41939 every 8 connection(s)
I20260811 06:55:04.492091 16701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:04.493229 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 16701
I20260811 06:55:04.493422 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:04.493976 12868 external_mini_cluster.cc:1428] Setting key 08241c88f1e7d3a6abf5446b846e5e5f
I20260811 06:55:04.496789 16807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:04.508780 16811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:04.495783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:51967 (local address 127.0.0.1:41939)
0811 06:55:04.496574 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:04.496590 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:04.496641 (+ 51us) server_negotiation.cc:407] Connection header received
0811 06:55:04.498913 (+ 2272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:04.498942 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:04.499448 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:04.499888 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:04.500431 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:04.502440 (+ 2009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:04.503740 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:04.504763 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:04.504935 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:04.506042 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:04.506053 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:04.506071 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:04.506804 (+ 733us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:04.506896 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:04.506933 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:04.507093 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:04.507294 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 06:55:04.507483 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":317,"threads_started":1}
I20260811 06:55:04.510567 16807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640: Bootstrap starting.
I20260811 06:55:04.512550 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:04.513737 16807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:04.514701 16807 log.cc:824] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:04.517700 16807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640: No bootstrap required, opened a new log
I20260811 06:55:04.523530 16811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:04.516919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:54505 (local address 127.0.0.1:41939)
0811 06:55:04.517101 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:04.517107 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:04.517435 (+ 328us) server_negotiation.cc:407] Connection header received
0811 06:55:04.517655 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:04.517658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:04.517723 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:04.517821 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:04.518410 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:04.519149 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:04.521035 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:04.521508 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:04.521640 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:04.522790 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:04.522795 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:04.522798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:04.522818 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:04.522856 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:04.522871 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:04.522956 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:04.523153 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 06:55:04.523200 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 06:55:04.526949 16807 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bce7de224f4b9cbdabaf635b2e2640" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41939 } }
I20260811 06:55:04.527359 16807 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:55:04.527452 16807 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66bce7de224f4b9cbdabaf635b2e2640, State: Initialized, Role: FOLLOWER
I20260811 06:55:04.528013 16807 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bce7de224f4b9cbdabaf635b2e2640" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41939 } }
I20260811 06:55:04.528234 16807 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:55:04.528333 16807 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:55:04.528472 16807 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:04.530717 16807 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bce7de224f4b9cbdabaf635b2e2640" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41939 } }
I20260811 06:55:04.531198 16807 leader_election.cc:302] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66bce7de224f4b9cbdabaf635b2e2640; no voters:
I20260811 06:55:04.531754 16807 leader_election.cc:288] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:55:04.531891 16824 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:04.532549 16824 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [term 1 LEADER]: Becoming Leader. State: Replica: 66bce7de224f4b9cbdabaf635b2e2640, State: Running, Role: LEADER
I20260811 06:55:04.533142 16824 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bce7de224f4b9cbdabaf635b2e2640" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41939 } }
I20260811 06:55:04.533958 16807 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:04.536154 16825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66bce7de224f4b9cbdabaf635b2e2640" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bce7de224f4b9cbdabaf635b2e2640" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41939 } } }
I20260811 06:55:04.536676 16825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:04.537123 16826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66bce7de224f4b9cbdabaf635b2e2640. Latest consensus state: current_term: 1 leader_uuid: "66bce7de224f4b9cbdabaf635b2e2640" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bce7de224f4b9cbdabaf635b2e2640" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41939 } } }
I20260811 06:55:04.537482 16826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:04.542435 16835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:04.547212 16835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:55:04.555647 16835 catalog_manager.cc:1347] Generated new cluster ID: 8757cca6167848118f49b37143b63e24
I20260811 06:55:04.555785 16835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:04.565007 16835 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:04.566834 16835 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:04.577637 16835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66bce7de224f4b9cbdabaf635b2e2640: Generated new TSK 0
I20260811 06:55:04.578487 16835 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:04.592403 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16701
W20260811 06:55:04.593658 16800 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.224:51967
W20260811 06:55:04.594475 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16701: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:55:04.594645 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 16701
W20260811 06:55:04.618381 16676 connection.cc:535] client connection to 127.0.0.1:41939 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41939): Connection reset by peer (error 104)
2026-08-11T06:55:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2117 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:04 dist-test-slave-7lbf krb5kdc[16856](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:04 dist-test-slave-7lbf krb5kdc[16856](info): set up 2 sockets
Aug 11 06:55:04 dist-test-slave-7lbf krb5kdc[16856](info): commencing operation
krb5kdc: starting...
W20260811 06:55:05.868400 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.003s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:06 dist-test-slave-7lbf krb5kdc[16856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 06:55:06.186655 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41205
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:06.524708 16876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:06.525017 16876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:06.525164 16876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:06.532833 16876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:06.533004 16876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:06.533085 16876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:06.533169 16876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:06.533226 16876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:06.543344 16876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41205
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:06.544637 16876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:06.546010 16876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:06.557272 16884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:06.557443 16883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:06.557581 16887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:06.558526 16876 server_base.cc:1034] running on GCE node
I20260811 06:55:06.559288 16876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:06.560683 16876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:06.561920 16876 hybrid_clock.cc:648] HybridClock initialized: now 1786431306561866 us; error 45 us; skew 500 ppm
I20260811 06:55:06.562252 16876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:06 dist-test-slave-7lbf krb5kdc[16856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431306, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:06.565402 16876 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 06:55:06.566910 16876 webserver.cc:460] Webserver started at http://127.0.0.1:38859/ using document root <none> and password file <none>
I20260811 06:55:06.567589 16876 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:06.567709 16876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:06.568006 16876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:06.571072 16876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "7ecab717591b4ec9a28ad4ef162b064c"
format_stamp: "Formatted at 2026-08-11 06:55:06 on dist-test-slave-7lbf"
server_key: "9926d8c9580e2cf531b818650ec6cc53"
server_key_iv: "99f5ad2948ba00eb888b0c5a015359a6"
server_key_version: "encryptionkey@0"
I20260811 06:55:06.571846 16876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "7ecab717591b4ec9a28ad4ef162b064c"
format_stamp: "Formatted at 2026-08-11 06:55:06 on dist-test-slave-7lbf"
server_key: "9926d8c9580e2cf531b818650ec6cc53"
server_key_iv: "99f5ad2948ba00eb888b0c5a015359a6"
server_key_version: "encryptionkey@0"
I20260811 06:55:06.577119 16876 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:55:06.580616 16897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:06.582126 16876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 06:55:06.582310 16876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "7ecab717591b4ec9a28ad4ef162b064c"
format_stamp: "Formatted at 2026-08-11 06:55:06 on dist-test-slave-7lbf"
server_key: "9926d8c9580e2cf531b818650ec6cc53"
server_key_iv: "99f5ad2948ba00eb888b0c5a015359a6"
server_key_version: "encryptionkey@0"
I20260811 06:55:06.582508 16876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:06.588308 16876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:06.592145 16876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:06.592420 16876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:06.609651 16876 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41205
I20260811 06:55:06.609681 16974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41205 every 8 connection(s)
I20260811 06:55:06.611023 16876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:06.614655 16976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:06.616294 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 16876
I20260811 06:55:06.616482 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:06.617034 12868 external_mini_cluster.cc:1428] Setting key b30cf2e3722406df1b92324f24ece679
I20260811 06:55:06.624670 16979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:06.618832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:40637 (local address 127.0.0.1:41205)
0811 06:55:06.619573 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:06.619586 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:06.619628 (+ 42us) server_negotiation.cc:407] Connection header received
0811 06:55:06.621218 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:06.621248 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:06.621651 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:06.622001 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:06.623066 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:06.623073 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:06.623087 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:06.623102 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:06.623165 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:06.623190 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:06.623364 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:06.623490 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 06:55:06.623688 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":326,"threads_started":1}
I20260811 06:55:06.628970 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:06.628968 16976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c: Bootstrap starting.
I20260811 06:55:06.632218 16976 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:06.633507 16976 log.cc:824] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:06.635742 16979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:06.633200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:43329 (local address 127.0.0.1:41205)
0811 06:55:06.633348 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:06.633353 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:06.633923 (+ 570us) server_negotiation.cc:407] Connection header received
0811 06:55:06.634111 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:06.634115 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:06.634169 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:06.634260 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:06.635143 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:06.635149 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:06.635154 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:06.635172 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:06.635211 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:06.635226 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:06.635320 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:06.635419 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 06:55:06.635481 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 06:55:06.636543 16976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c: No bootstrap required, opened a new log
I20260811 06:55:06.643992 16976 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab717591b4ec9a28ad4ef162b064c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260811 06:55:06.644377 16976 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:55:06.644483 16976 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ecab717591b4ec9a28ad4ef162b064c, State: Initialized, Role: FOLLOWER
I20260811 06:55:06.645072 16976 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab717591b4ec9a28ad4ef162b064c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260811 06:55:06.645303 16976 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:55:06.645437 16976 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:55:06.645651 16976 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:06.647852 16976 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab717591b4ec9a28ad4ef162b064c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260811 06:55:06.648484 16976 leader_election.cc:302] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ecab717591b4ec9a28ad4ef162b064c; no voters:
I20260811 06:55:06.649060 16976 leader_election.cc:288] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:55:06.649190 16988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:06.649899 16988 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [term 1 LEADER]: Becoming Leader. State: Replica: 7ecab717591b4ec9a28ad4ef162b064c, State: Running, Role: LEADER
I20260811 06:55:06.650463 16988 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab717591b4ec9a28ad4ef162b064c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260811 06:55:06.651165 16976 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:06.653492 16991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ecab717591b4ec9a28ad4ef162b064c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab717591b4ec9a28ad4ef162b064c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } } }
I20260811 06:55:06.654122 16991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:06.653436 16996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ecab717591b4ec9a28ad4ef162b064c. Latest consensus state: current_term: 1 leader_uuid: "7ecab717591b4ec9a28ad4ef162b064c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecab717591b4ec9a28ad4ef162b064c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } } }
I20260811 06:55:06.654896 16996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:06.660445 17000 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:06.666162 17000 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:55:06.675194 17000 catalog_manager.cc:1347] Generated new cluster ID: 5b931626838c49168a32ecbb2063e656
I20260811 06:55:06.675324 17000 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:06.689061 17000 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:06.689471 17000 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:06.700280 17000 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ecab717591b4ec9a28ad4ef162b064c: Generated new TSK 0
I20260811 06:55:06.701116 17000 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:06.715040 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16876
W20260811 06:55:06.716200 16967 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.224:40637
W20260811 06:55:06.716969 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 16876: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:55:06.717109 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 16876
2026-08-11T06:55:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2127 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:06 dist-test-slave-7lbf krb5kdc[17023](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:06 dist-test-slave-7lbf krb5kdc[17023](info): set up 2 sockets
Aug 11 06:55:06 dist-test-slave-7lbf krb5kdc[17023](info): commencing operation
krb5kdc: starting...
W20260811 06:55:07.984540 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:08 dist-test-slave-7lbf krb5kdc[17023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:55:08.302256 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:34909
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:34707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:34909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:08.649158 17047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:08.649447 17047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:08.649623 17047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:08.657289 17047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:08.657404 17047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:08.657456 17047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:08.657549 17047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:08.657609 17047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:08.667588 17047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:34707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:34909
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:34909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:08.668840 17047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:08.670233 17047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:08.681847 17052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:08.681799 17055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:08.681887 17053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:08.683347 17047 server_base.cc:1034] running on GCE node
I20260811 06:55:08.684182 17047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:08.685684 17047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:08.686932 17047 hybrid_clock.cc:648] HybridClock initialized: now 1786431308686876 us; error 40 us; skew 500 ppm
I20260811 06:55:08.687289 17047 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:08 dist-test-slave-7lbf krb5kdc[17023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431308, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:08.690521 17047 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:55:08.691977 17047 webserver.cc:460] Webserver started at http://127.12.145.62:39753/ using document root <none> and password file <none>
I20260811 06:55:08.692662 17047 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:08.692780 17047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:08.693070 17047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:08.696224 17047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "0b6fd30d823441b29b6b751a6fc2f033"
format_stamp: "Formatted at 2026-08-11 06:55:08 on dist-test-slave-7lbf"
server_key: "5780975555bda3ccd703ffe1870a97a8"
server_key_iv: "4ad431e6225407869714599a99f6683b"
server_key_version: "encryptionkey@0"
I20260811 06:55:08.696985 17047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "0b6fd30d823441b29b6b751a6fc2f033"
format_stamp: "Formatted at 2026-08-11 06:55:08 on dist-test-slave-7lbf"
server_key: "5780975555bda3ccd703ffe1870a97a8"
server_key_iv: "4ad431e6225407869714599a99f6683b"
server_key_version: "encryptionkey@0"
I20260811 06:55:08.702409 17047 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 06:55:08.705941 17076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:08.707230 17047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 06:55:08.707405 17047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "0b6fd30d823441b29b6b751a6fc2f033"
format_stamp: "Formatted at 2026-08-11 06:55:08 on dist-test-slave-7lbf"
server_key: "5780975555bda3ccd703ffe1870a97a8"
server_key_iv: "4ad431e6225407869714599a99f6683b"
server_key_version: "encryptionkey@0"
I20260811 06:55:08.707597 17047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:08.729562 17047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:08.733734 17047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:08.733999 17047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:08.751256 17047 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:34909
I20260811 06:55:08.751276 17161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:34909 every 8 connection(s)
I20260811 06:55:08.752585 17047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:08.756208 17162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:08.762985 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17047
I20260811 06:55:08.763178 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:08.763749 12868 external_mini_cluster.cc:1428] Setting key 7daabd7f7f9789e6fd29d5cbad20bd82
I20260811 06:55:08.767338 17162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033: Bootstrap starting.
I20260811 06:55:08.771070 17162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:08.772200 17162 log.cc:824] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:08.775293 17162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033: No bootstrap required, opened a new log
Aug 11 06:55:08 dist-test-slave-7lbf krb5kdc[17023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:55:08.785418 17162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b6fd30d823441b29b6b751a6fc2f033" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34909 } }
I20260811 06:55:08.785997 17162 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:55:08.786167 17162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b6fd30d823441b29b6b751a6fc2f033, State: Initialized, Role: FOLLOWER
I20260811 06:55:08.786998 17162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b6fd30d823441b29b6b751a6fc2f033" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34909 } }
I20260811 06:55:08.787349 17162 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:55:08.787516 17162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:55:08.787699 17162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:08.790380 17166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:08.765736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46969 (local address 127.12.145.62:34909)
0811 06:55:08.766570 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:08.766581 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:08.766623 (+ 42us) server_negotiation.cc:407] Connection header received
0811 06:55:08.768370 (+ 1747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:08.768394 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:08.768783 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:08.769114 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:08.771034 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:08.772449 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:08.774028 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:08.774735 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:08.774887 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:08.779831 (+ 4944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:08.779843 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:08.779869 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:08.779924 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:08.784143 (+ 4219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:08.785081 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:08.785091 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:08.785100 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:08.785336 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:08.786007 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:08.786013 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:08.786017 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:08.786843 (+ 826us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:08.787210 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:08.788533 (+ 1323us) server_negotiation.cc:299] Negotiation successful
0811 06:55:08.788920 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":359,"threads_started":1}
I20260811 06:55:08.791141 17162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b6fd30d823441b29b6b751a6fc2f033" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34909 } }
I20260811 06:55:08.791730 17162 leader_election.cc:302] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b6fd30d823441b29b6b751a6fc2f033; no voters:
I20260811 06:55:08.792562 17162 leader_election.cc:288] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:55:08.792689 17168 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:08.795603 17162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:08.795331 17168 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [term 1 LEADER]: Becoming Leader. State: Replica: 0b6fd30d823441b29b6b751a6fc2f033, State: Running, Role: LEADER
I20260811 06:55:08.796325 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:08.796663 17168 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b6fd30d823441b29b6b751a6fc2f033" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34909 } }
I20260811 06:55:08.799787 17171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b6fd30d823441b29b6b751a6fc2f033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b6fd30d823441b29b6b751a6fc2f033" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34909 } } }
I20260811 06:55:08.800226 17171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:08.805131 17170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b6fd30d823441b29b6b751a6fc2f033. Latest consensus state: current_term: 1 leader_uuid: "0b6fd30d823441b29b6b751a6fc2f033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b6fd30d823441b29b6b751a6fc2f033" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 34909 } } }
I20260811 06:55:08.806797 17188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:08.812395 17188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:55:08.816779 17170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:08.824530 17188 catalog_manager.cc:1347] Generated new cluster ID: 216abc35d898404e98e275618a604887
I20260811 06:55:08.824707 17188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:08.839040 17166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:08.820788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44565 (local address 127.12.145.62:34909)
0811 06:55:08.820981 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:08.820988 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:08.822214 (+ 1226us) server_negotiation.cc:407] Connection header received
0811 06:55:08.822543 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:08.822550 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:08.822638 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:08.822777 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:08.825078 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:08.826347 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:08.828182 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:08.828826 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:08.828936 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:08.832020 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:08.832027 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:08.832032 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:08.832068 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:08.835690 (+ 3622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:08.836596 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:08.836602 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:08.836606 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:08.836774 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:08.837292 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:08.837297 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:08.837301 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:08.837750 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:08.838049 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:08.838452 (+ 403us) server_negotiation.cc:299] Negotiation successful
0811 06:55:08.838630 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":61}
I20260811 06:55:08.841821 17188 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:08.843062 17188 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:08.853163 17188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b6fd30d823441b29b6b751a6fc2f033: Generated new TSK 0
I20260811 06:55:08.854024 17188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:08.863348 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17047
I20260811 06:55:08.864585 17151 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:55:08.954249 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17047
W20260811 06:55:08.976495 17020 connection.cc:535] client connection to 127.12.145.62:34909 recv error: Network error: failed to read from TLS socket (remote: 127.12.145.62:34909): Connection reset by peer (error 104)
2026-08-11T06:55:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2230 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:09 dist-test-slave-7lbf krb5kdc[17220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:09 dist-test-slave-7lbf krb5kdc[17220](info): set up 2 sockets
Aug 11 06:55:09 dist-test-slave-7lbf krb5kdc[17220](info): commencing operation
krb5kdc: starting...
W20260811 06:55:10.245416 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.004s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:10 dist-test-slave-7lbf krb5kdc[17220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:55:10.564844 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:45623
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:38567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:45623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:10.918900 17237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:10.919222 17237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:10.919477 17237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:10.926923 17237 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:10.927043 17237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:10.927109 17237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:10.927192 17237 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:10.927253 17237 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:10.937330 17237 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:38567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:45623
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:45623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:10.938681 17237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:10.939988 17237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:10.951501 17246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:10.951467 17253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:10.951538 17250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:10.952447 17237 server_base.cc:1034] running on GCE node
I20260811 06:55:10.953150 17237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:10.954555 17237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:10.955776 17237 hybrid_clock.cc:648] HybridClock initialized: now 1786431310955727 us; error 41 us; skew 500 ppm
I20260811 06:55:10.956131 17237 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:10 dist-test-slave-7lbf krb5kdc[17220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431310, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:10.961481 17237 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:55:10.963162 17237 webserver.cc:460] Webserver started at http://127.12.145.62:34375/ using document root <none> and password file <none>
I20260811 06:55:10.963872 17237 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:10.964001 17237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:10.964314 17237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:10.967371 17237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "5125a9b46bf54dd7a79a35e2c697f6be"
format_stamp: "Formatted at 2026-08-11 06:55:10 on dist-test-slave-7lbf"
server_key: "859d569db63f0e6fe84ecd0816ce5f83"
server_key_iv: "434daa0b594c1e6f3cdb2117d458a0fa"
server_key_version: "encryptionkey@0"
I20260811 06:55:10.968127 17237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "5125a9b46bf54dd7a79a35e2c697f6be"
format_stamp: "Formatted at 2026-08-11 06:55:10 on dist-test-slave-7lbf"
server_key: "859d569db63f0e6fe84ecd0816ce5f83"
server_key_iv: "434daa0b594c1e6f3cdb2117d458a0fa"
server_key_version: "encryptionkey@0"
I20260811 06:55:10.973418 17237 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:55:10.977061 17263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:10.978551 17237 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:55:10.978713 17237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "5125a9b46bf54dd7a79a35e2c697f6be"
format_stamp: "Formatted at 2026-08-11 06:55:10 on dist-test-slave-7lbf"
server_key: "859d569db63f0e6fe84ecd0816ce5f83"
server_key_iv: "434daa0b594c1e6f3cdb2117d458a0fa"
server_key_version: "encryptionkey@0"
I20260811 06:55:10.978902 17237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:11.002303 17237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:11.006603 17237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:11.006887 17237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:11.024981 17237 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:45623
I20260811 06:55:11.025004 17348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:45623 every 8 connection(s)
I20260811 06:55:11.026371 17237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:11.027792 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17237
I20260811 06:55:11.027978 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:11.028544 12868 external_mini_cluster.cc:1428] Setting key afb77cb79c152445c264e7223ce475a9
I20260811 06:55:11.031037 17349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:11.042007 17354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:11.030328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41985 (local address 127.12.145.62:45623)
0811 06:55:11.031131 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:11.031148 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:11.031199 (+ 51us) server_negotiation.cc:407] Connection header received
0811 06:55:11.032843 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:11.032868 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:11.033251 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:11.033703 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:11.034227 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:11.035555 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:11.037447 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:11.038186 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:11.038331 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:11.039641 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:11.039649 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:11.039664 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:11.040218 (+ 554us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:11.040299 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:11.040328 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:11.040461 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:11.040752 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 06:55:11.040948 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":351,"threads_started":1}
I20260811 06:55:11.043143 17349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be: Bootstrap starting.
I20260811 06:55:11.045759 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:11.046437 17349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:11.047652 17349 log.cc:824] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:11.051004 17349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be: No bootstrap required, opened a new log
I20260811 06:55:11.057300 17354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:11.050829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47441 (local address 127.12.145.62:45623)
0811 06:55:11.051014 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:11.051020 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:11.051411 (+ 391us) server_negotiation.cc:407] Connection header received
0811 06:55:11.051580 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:11.051585 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:11.051666 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:11.051774 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:11.052209 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:11.053396 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:11.054715 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:11.055386 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:11.055507 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:11.056525 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:11.056532 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:11.056537 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:11.056559 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:11.056612 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:11.056634 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:11.056760 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:11.056892 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 06:55:11.056952 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 06:55:11.060065 17349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5125a9b46bf54dd7a79a35e2c697f6be" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45623 } }
I20260811 06:55:11.060437 17349 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:55:11.060518 17349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5125a9b46bf54dd7a79a35e2c697f6be, State: Initialized, Role: FOLLOWER
I20260811 06:55:11.061043 17349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5125a9b46bf54dd7a79a35e2c697f6be" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45623 } }
I20260811 06:55:11.061252 17349 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:55:11.061383 17349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:55:11.061573 17349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:11.063825 17349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5125a9b46bf54dd7a79a35e2c697f6be" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45623 } }
I20260811 06:55:11.064332 17349 leader_election.cc:302] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5125a9b46bf54dd7a79a35e2c697f6be; no voters:
I20260811 06:55:11.064898 17349 leader_election.cc:288] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:55:11.065022 17364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:11.065701 17364 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [term 1 LEADER]: Becoming Leader. State: Replica: 5125a9b46bf54dd7a79a35e2c697f6be, State: Running, Role: LEADER
I20260811 06:55:11.066264 17364 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5125a9b46bf54dd7a79a35e2c697f6be" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45623 } }
I20260811 06:55:11.066994 17349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:11.069131 17368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5125a9b46bf54dd7a79a35e2c697f6be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5125a9b46bf54dd7a79a35e2c697f6be" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45623 } } }
I20260811 06:55:11.069233 17370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5125a9b46bf54dd7a79a35e2c697f6be. Latest consensus state: current_term: 1 leader_uuid: "5125a9b46bf54dd7a79a35e2c697f6be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5125a9b46bf54dd7a79a35e2c697f6be" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 45623 } } }
I20260811 06:55:11.069613 17368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:11.069612 17370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:11.070386 17380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:11.075829 17380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:55:11.085306 17380 catalog_manager.cc:1347] Generated new cluster ID: 5aa15670001846b7b1b6d2b4c8bbef0c
I20260811 06:55:11.085505 17380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:11.101636 17380 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:11.102907 17380 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:11.114605 17380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5125a9b46bf54dd7a79a35e2c697f6be: Generated new TSK 0
I20260811 06:55:11.115440 17380 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:11.122737 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17237
W20260811 06:55:11.124068 17343 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41985
W20260811 06:55:11.124846 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17237: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:55:11.125021 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17237
W20260811 06:55:11.150219 17218 connection.cc:535] client connection to 127.12.145.62:45623 recv error: Network error: failed to read from TLS socket (remote: 127.12.145.62:45623): Connection reset by peer (error 104)
2026-08-11T06:55:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2173 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:11 dist-test-slave-7lbf krb5kdc[17399](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:11 dist-test-slave-7lbf krb5kdc[17399](info): set up 2 sockets
Aug 11 06:55:11 dist-test-slave-7lbf krb5kdc[17399](info): commencing operation
krb5kdc: starting...
W20260811 06:55:12.380564 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:12 dist-test-slave-7lbf krb5kdc[17399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:55:12.709607 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43179
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:43179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:13.051556 17420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:13.051843 17420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:13.051988 17420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:13.059156 17420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:13.059278 17420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:13.059353 17420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:13.059429 17420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:13.059476 17420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:13.069353 17420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:43179
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:13.070696 17420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:13.072058 17420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:13.083730 17427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:13.083798 17429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:13.083895 17433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:13.084908 17420 server_base.cc:1034] running on GCE node
I20260811 06:55:13.085742 17420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:13.087181 17420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:13.088406 17420 hybrid_clock.cc:648] HybridClock initialized: now 1786431313088345 us; error 49 us; skew 500 ppm
I20260811 06:55:13.088757 17420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:13 dist-test-slave-7lbf krb5kdc[17399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431313, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:13.092011 17420 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:55:13.093605 17420 webserver.cc:460] Webserver started at http://127.12.145.62:39017/ using document root <none> and password file <none>
I20260811 06:55:13.094354 17420 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:13.094483 17420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:13.094843 17420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:13.098114 17420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "de3ac6ada4e0452083730925f99a7f33"
format_stamp: "Formatted at 2026-08-11 06:55:13 on dist-test-slave-7lbf"
server_key: "cfb1d218abe905e2ba99ed2bf5aba4aa"
server_key_iv: "262b7f33b1dcfd953632ee181fd7cae1"
server_key_version: "encryptionkey@0"
I20260811 06:55:13.098953 17420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "de3ac6ada4e0452083730925f99a7f33"
format_stamp: "Formatted at 2026-08-11 06:55:13 on dist-test-slave-7lbf"
server_key: "cfb1d218abe905e2ba99ed2bf5aba4aa"
server_key_iv: "262b7f33b1dcfd953632ee181fd7cae1"
server_key_version: "encryptionkey@0"
I20260811 06:55:13.104513 17420 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260811 06:55:13.108232 17444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:13.109603 17420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:55:13.109771 17420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "de3ac6ada4e0452083730925f99a7f33"
format_stamp: "Formatted at 2026-08-11 06:55:13 on dist-test-slave-7lbf"
server_key: "cfb1d218abe905e2ba99ed2bf5aba4aa"
server_key_iv: "262b7f33b1dcfd953632ee181fd7cae1"
server_key_version: "encryptionkey@0"
I20260811 06:55:13.110000 17420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:13.115842 17420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:13.119946 17420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:13.120275 17420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:13.138908 17420 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:43179
I20260811 06:55:13.138911 17531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:43179 every 8 connection(s)
I20260811 06:55:13.140424 17420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:13.140822 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17420
I20260811 06:55:13.140978 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:13.141480 12868 external_mini_cluster.cc:1428] Setting key e59bf83281c32fc890b3c701df818e80
I20260811 06:55:13.144933 17532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:13.149111 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:13.143354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46905 (local address 127.12.145.62:43179)
0811 06:55:13.144156 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:13.144168 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:13.144209 (+ 41us) server_negotiation.cc:407] Connection header received
0811 06:55:13.145913 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:13.145935 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:13.146254 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:13.146558 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:13.147627 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:13.147634 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:13.147646 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:13.147660 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:13.147745 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:13.147766 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:13.147939 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:13.148054 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 06:55:13.148219 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":346,"threads_started":1}
I20260811 06:55:13.153102 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:13.157584 17532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33: Bootstrap starting.
I20260811 06:55:13.159901 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:13.157388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35493 (local address 127.12.145.62:43179)
0811 06:55:13.157557 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:13.157563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:13.158129 (+ 566us) server_negotiation.cc:407] Connection header received
0811 06:55:13.158286 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:13.158291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:13.158340 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:13.158419 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:13.159278 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:13.159285 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:13.159294 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:13.159312 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:13.159353 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:13.159368 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:13.159464 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:13.159585 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 06:55:13.159642 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 06:55:13.161154 17532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:13.162325 17532 log.cc:824] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:13.165086 17532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33: No bootstrap required, opened a new log
I20260811 06:55:13.173352 17532 raft_consensus.cc:348] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3ac6ada4e0452083730925f99a7f33" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43179 } }
I20260811 06:55:13.173804 17532 raft_consensus.cc:374] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:55:13.173930 17532 raft_consensus.cc:729] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de3ac6ada4e0452083730925f99a7f33, State: Initialized, Role: FOLLOWER
I20260811 06:55:13.174634 17532 consensus_queue.cc:260] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3ac6ada4e0452083730925f99a7f33" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43179 } }
I20260811 06:55:13.174919 17532 raft_consensus.cc:388] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:55:13.175076 17532 raft_consensus.cc:482] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:55:13.175242 17532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:13.177506 17532 raft_consensus.cc:504] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3ac6ada4e0452083730925f99a7f33" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43179 } }
I20260811 06:55:13.178097 17532 leader_election.cc:302] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de3ac6ada4e0452083730925f99a7f33; no voters:
I20260811 06:55:13.178685 17532 leader_election.cc:288] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:55:13.178792 17549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:13.179422 17549 raft_consensus.cc:686] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [term 1 LEADER]: Becoming Leader. State: Replica: de3ac6ada4e0452083730925f99a7f33, State: Running, Role: LEADER
I20260811 06:55:13.180001 17549 consensus_queue.cc:237] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3ac6ada4e0452083730925f99a7f33" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43179 } }
I20260811 06:55:13.180802 17532 sys_catalog.cc:564] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:13.182731 17552 sys_catalog.cc:455] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de3ac6ada4e0452083730925f99a7f33. Latest consensus state: current_term: 1 leader_uuid: "de3ac6ada4e0452083730925f99a7f33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3ac6ada4e0452083730925f99a7f33" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43179 } } }
I20260811 06:55:13.183197 17552 sys_catalog.cc:458] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:13.183182 17551 sys_catalog.cc:455] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de3ac6ada4e0452083730925f99a7f33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3ac6ada4e0452083730925f99a7f33" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43179 } } }
I20260811 06:55:13.183542 17551 sys_catalog.cc:458] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:13.185624 17562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:13.191299 17562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:55:13.200325 17562 catalog_manager.cc:1347] Generated new cluster ID: 4a6cc78a7c274d7591241cbce9e87e31
I20260811 06:55:13.200523 17562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:13.219893 17562 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:13.220485 17562 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:13.229135 17562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de3ac6ada4e0452083730925f99a7f33: Generated new TSK 0
I20260811 06:55:13.230008 17562 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:13.239660 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17420
W20260811 06:55:13.240815 17525 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46905
W20260811 06:55:13.241614 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17420: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:55:13.241775 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17420
2026-08-11T06:55:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2119 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:13 dist-test-slave-7lbf krb5kdc[17587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:13 dist-test-slave-7lbf krb5kdc[17587](info): set up 2 sockets
Aug 11 06:55:13 dist-test-slave-7lbf krb5kdc[17587](info): commencing operation
krb5kdc: starting...
W20260811 06:55:14.509410 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:14 dist-test-slave-7lbf krb5kdc[17587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:55:14.834311 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:41975
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:35503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:41975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:15.176595 17601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:15.176900 17601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:15.177032 17601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:15.184242 17601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:15.184392 17601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:15.184458 17601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:15.184520 17601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:15.184563 17601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:15.194329 17601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:35503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:41975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:41975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:15.195632 17601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:15.196900 17601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:15.208424 17610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:15.208534 17608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:15.208389 17612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:15.209546 17601 server_base.cc:1034] running on GCE node
I20260811 06:55:15.210356 17601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:15.211771 17601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:15.213027 17601 hybrid_clock.cc:648] HybridClock initialized: now 1786431315212968 us; error 52 us; skew 500 ppm
I20260811 06:55:15.213388 17601 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:15 dist-test-slave-7lbf krb5kdc[17587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:15.216506 17601 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:55:15.218132 17601 webserver.cc:460] Webserver started at http://127.12.145.62:35613/ using document root <none> and password file <none>
I20260811 06:55:15.218827 17601 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:15.218954 17601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:15.219266 17601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:15.222415 17601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "e35dbdcb30ab4c219f81c738454fb641"
format_stamp: "Formatted at 2026-08-11 06:55:15 on dist-test-slave-7lbf"
server_key: "83e361a327a53109c29548b6fa053074"
server_key_iv: "5259a56d054fac71480c55ad291ebf47"
server_key_version: "encryptionkey@0"
I20260811 06:55:15.223229 17601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "e35dbdcb30ab4c219f81c738454fb641"
format_stamp: "Formatted at 2026-08-11 06:55:15 on dist-test-slave-7lbf"
server_key: "83e361a327a53109c29548b6fa053074"
server_key_iv: "5259a56d054fac71480c55ad291ebf47"
server_key_version: "encryptionkey@0"
I20260811 06:55:15.228590 17601 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 06:55:15.232251 17620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:15.233700 17601 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:55:15.233873 17601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "e35dbdcb30ab4c219f81c738454fb641"
format_stamp: "Formatted at 2026-08-11 06:55:15 on dist-test-slave-7lbf"
server_key: "83e361a327a53109c29548b6fa053074"
server_key_iv: "5259a56d054fac71480c55ad291ebf47"
server_key_version: "encryptionkey@0"
I20260811 06:55:15.234074 17601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:15.253862 17601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:15.258279 17601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:15.258563 17601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:15.276710 17601 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:41975
I20260811 06:55:15.276729 17699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:41975 every 8 connection(s)
I20260811 06:55:15.278121 17601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:15.281922 17700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:15.286448 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17601
I20260811 06:55:15.286636 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:15.287225 12868 external_mini_cluster.cc:1428] Setting key a9c94b890d8f1b23e8bf629cd02f1a5e
I20260811 06:55:15.293633 17700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641: Bootstrap starting.
I20260811 06:55:15.297314 17700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:15.298499 17700 log.cc:824] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:15.301990 17700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641: No bootstrap required, opened a new log
Aug 11 06:55:15 dist-test-slave-7lbf krb5kdc[17587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:55:15.310243 17700 raft_consensus.cc:348] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35dbdcb30ab4c219f81c738454fb641" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41975 } }
I20260811 06:55:15.310675 17700 raft_consensus.cc:374] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:55:15.310771 17700 raft_consensus.cc:729] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e35dbdcb30ab4c219f81c738454fb641, State: Initialized, Role: FOLLOWER
I20260811 06:55:15.311106 17712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:15.289164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34277 (local address 127.12.145.62:41975)
0811 06:55:15.290001 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:15.290013 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:15.290059 (+ 46us) server_negotiation.cc:407] Connection header received
0811 06:55:15.292056 (+ 1997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:15.292081 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:15.292487 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:15.292831 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:15.294692 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:15.296049 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:15.297809 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:15.298503 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:15.298657 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:15.303326 (+ 4669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:15.303335 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:15.303352 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:15.303392 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:15.306703 (+ 3311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:15.307426 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:15.307433 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:15.307440 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:15.307631 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:15.308058 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:15.308062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:15.308064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:15.308671 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:15.308979 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:15.309457 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 06:55:15.309915 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":406,"threads_started":1}
I20260811 06:55:15.311378 17700 consensus_queue.cc:260] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35dbdcb30ab4c219f81c738454fb641" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41975 } }
I20260811 06:55:15.311626 17700 raft_consensus.cc:388] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:55:15.311765 17700 raft_consensus.cc:482] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:55:15.311937 17700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:15.314465 17700 raft_consensus.cc:504] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35dbdcb30ab4c219f81c738454fb641" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41975 } }
I20260811 06:55:15.314855 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:15.314991 17700 leader_election.cc:302] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e35dbdcb30ab4c219f81c738454fb641; no voters:
I20260811 06:55:15.315613 17700 leader_election.cc:288] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:55:15.315742 17714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:15.317893 17700 sys_catalog.cc:564] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:15.322559 17714 raft_consensus.cc:686] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [term 1 LEADER]: Becoming Leader. State: Replica: e35dbdcb30ab4c219f81c738454fb641, State: Running, Role: LEADER
I20260811 06:55:15.323220 17714 consensus_queue.cc:237] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35dbdcb30ab4c219f81c738454fb641" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41975 } }
I20260811 06:55:15.326412 17717 sys_catalog.cc:455] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e35dbdcb30ab4c219f81c738454fb641" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35dbdcb30ab4c219f81c738454fb641" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41975 } } }
I20260811 06:55:15.326869 17717 sys_catalog.cc:458] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:15.327461 17723 sys_catalog.cc:455] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e35dbdcb30ab4c219f81c738454fb641. Latest consensus state: current_term: 1 leader_uuid: "e35dbdcb30ab4c219f81c738454fb641" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e35dbdcb30ab4c219f81c738454fb641" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41975 } } }
I20260811 06:55:15.327771 17734 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:15.327839 17723 sys_catalog.cc:458] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:15.340437 17734 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:55:15.356382 17712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:15.323348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46425 (local address 127.12.145.62:41975)
0811 06:55:15.323529 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:15.323535 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:15.338855 (+ 15320us) server_negotiation.cc:407] Connection header received
0811 06:55:15.339182 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:15.339188 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:15.339275 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:15.339369 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:15.341688 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:15.342797 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:15.344613 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:15.345274 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:15.345395 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:15.348626 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:15.348633 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:15.348638 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:15.348677 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:15.352700 (+ 4023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:15.353663 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:15.353670 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:15.353675 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:15.353838 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:15.354354 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:15.354359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:15.354363 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:15.354796 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:15.355040 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:15.355710 (+ 670us) server_negotiation.cc:299] Negotiation successful
0811 06:55:15.355954 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 06:55:15.361939 17734 catalog_manager.cc:1347] Generated new cluster ID: d2f79595a8c9455380b0602e6cb4c94a
I20260811 06:55:15.362056 17734 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:15.384420 17734 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:15.385864 17734 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:15.398589 17734 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e35dbdcb30ab4c219f81c738454fb641: Generated new TSK 0
I20260811 06:55:15.399681 17734 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:15.413120 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17601
I20260811 06:55:15.414203 17693 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:55:15.508008 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17601
2026-08-11T06:55:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2264 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:15 dist-test-slave-7lbf krb5kdc[17761](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:15 dist-test-slave-7lbf krb5kdc[17761](info): set up 2 sockets
Aug 11 06:55:15 dist-test-slave-7lbf krb5kdc[17761](info): commencing operation
krb5kdc: starting...
W20260811 06:55:16.766796 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.003s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:16 dist-test-slave-7lbf krb5kdc[17761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:55:17.089174 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:41127
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:42559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:41127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:17.434899 17785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:17.435201 17785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:17.435310 17785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:17.442677 17785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:17.442812 17785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:17.442875 17785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:17.442945 17785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:17.442997 17785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:17.453173 17785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:42559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:41127
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:41127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:17.454473 17785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:17.455801 17785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:17.468693 17792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:17.468641 17800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:17.468603 17793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:17.469663 17785 server_base.cc:1034] running on GCE node
I20260811 06:55:17.470474 17785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:17.471962 17785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:17.473196 17785 hybrid_clock.cc:648] HybridClock initialized: now 1786431317473135 us; error 48 us; skew 500 ppm
I20260811 06:55:17.473632 17785 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:17 dist-test-slave-7lbf krb5kdc[17761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431317, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:17.480028 17785 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:55:17.481467 17785 webserver.cc:460] Webserver started at http://127.12.145.62:41885/ using document root <none> and password file <none>
I20260811 06:55:17.482162 17785 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:17.482268 17785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:17.482532 17785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:17.485455 17785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "db892aa1e1674a48a912d2a28163dec7"
format_stamp: "Formatted at 2026-08-11 06:55:17 on dist-test-slave-7lbf"
server_key: "b803dd337d32d4114961979f3109afaa"
server_key_iv: "6fd9331e6f8bc179d58c6431da243d89"
server_key_version: "encryptionkey@0"
I20260811 06:55:17.486205 17785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "db892aa1e1674a48a912d2a28163dec7"
format_stamp: "Formatted at 2026-08-11 06:55:17 on dist-test-slave-7lbf"
server_key: "b803dd337d32d4114961979f3109afaa"
server_key_iv: "6fd9331e6f8bc179d58c6431da243d89"
server_key_version: "encryptionkey@0"
I20260811 06:55:17.491295 17785 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 06:55:17.494783 17817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:17.496136 17785 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 06:55:17.496299 17785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "db892aa1e1674a48a912d2a28163dec7"
format_stamp: "Formatted at 2026-08-11 06:55:17 on dist-test-slave-7lbf"
server_key: "b803dd337d32d4114961979f3109afaa"
server_key_iv: "6fd9331e6f8bc179d58c6431da243d89"
server_key_version: "encryptionkey@0"
I20260811 06:55:17.496497 17785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:17.541253 17785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:17.546160 17785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:17.546479 17785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:17.565549 17785 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:41127
I20260811 06:55:17.565596 17896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:41127 every 8 connection(s)
I20260811 06:55:17.567041 17785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:17.570798 17897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:17.571313 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17785
I20260811 06:55:17.571475 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:17.571941 12868 external_mini_cluster.cc:1428] Setting key 9229f7195718fe3b634bbdb51b238580
I20260811 06:55:17.585079 17897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7: Bootstrap starting.
I20260811 06:55:17.587322 17900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:17.573981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53401 (local address 127.12.145.62:41127)
0811 06:55:17.574800 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:17.574815 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:17.574865 (+ 50us) server_negotiation.cc:407] Connection header received
0811 06:55:17.577265 (+ 2400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:17.577295 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:17.577864 (+ 569us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:17.578321 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:17.578823 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:17.580659 (+ 1836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:17.582185 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:17.583244 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:17.583423 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:17.584567 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:17.584578 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:17.584600 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:17.585297 (+ 697us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:17.585391 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:17.585424 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:17.585571 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:17.585787 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 06:55:17.586044 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":334,"threads_started":1}
I20260811 06:55:17.588954 17897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:17.590262 17897 log.cc:824] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:17.591111 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:17.592971 17897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7: No bootstrap required, opened a new log
I20260811 06:55:17.601961 17897 raft_consensus.cc:348] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db892aa1e1674a48a912d2a28163dec7" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41127 } }
I20260811 06:55:17.602468 17900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:17.595614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40991 (local address 127.12.145.62:41127)
0811 06:55:17.595828 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:17.595836 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:17.596347 (+ 511us) server_negotiation.cc:407] Connection header received
0811 06:55:17.596530 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:17.596534 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:17.596597 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:17.596681 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:17.597256 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:17.598094 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:17.599939 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:17.600464 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:17.600622 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:17.601733 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:17.601739 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:17.601742 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:17.601761 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:17.601809 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:17.601827 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:17.601904 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:17.602048 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 06:55:17.602124 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:55:17.602475 17897 raft_consensus.cc:374] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:55:17.602643 17897 raft_consensus.cc:729] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db892aa1e1674a48a912d2a28163dec7, State: Initialized, Role: FOLLOWER
I20260811 06:55:17.603206 17897 consensus_queue.cc:260] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db892aa1e1674a48a912d2a28163dec7" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41127 } }
I20260811 06:55:17.603447 17897 raft_consensus.cc:388] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:55:17.603580 17897 raft_consensus.cc:482] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:55:17.603746 17897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:17.605962 17897 raft_consensus.cc:504] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db892aa1e1674a48a912d2a28163dec7" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41127 } }
I20260811 06:55:17.606457 17897 leader_election.cc:302] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db892aa1e1674a48a912d2a28163dec7; no voters:
I20260811 06:55:17.607033 17897 leader_election.cc:288] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:55:17.607192 17911 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:17.607903 17911 raft_consensus.cc:686] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [term 1 LEADER]: Becoming Leader. State: Replica: db892aa1e1674a48a912d2a28163dec7, State: Running, Role: LEADER
I20260811 06:55:17.608537 17911 consensus_queue.cc:237] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db892aa1e1674a48a912d2a28163dec7" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41127 } }
I20260811 06:55:17.609095 17897 sys_catalog.cc:564] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:17.611729 17913 sys_catalog.cc:455] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db892aa1e1674a48a912d2a28163dec7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db892aa1e1674a48a912d2a28163dec7" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41127 } } }
I20260811 06:55:17.611692 17917 sys_catalog.cc:455] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db892aa1e1674a48a912d2a28163dec7. Latest consensus state: current_term: 1 leader_uuid: "db892aa1e1674a48a912d2a28163dec7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db892aa1e1674a48a912d2a28163dec7" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 41127 } } }
I20260811 06:55:17.612850 17917 sys_catalog.cc:458] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:17.612903 17913 sys_catalog.cc:458] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:17.613976 17925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:17.621166 17925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:55:17.630668 17925 catalog_manager.cc:1347] Generated new cluster ID: 0a9e119fcb4248579ed3a2e8064b6995
I20260811 06:55:17.630765 17925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:17.655581 17925 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:17.656905 17925 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:17.669443 17925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db892aa1e1674a48a912d2a28163dec7: Generated new TSK 0
I20260811 06:55:17.670361 17925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:17.677790 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17785
W20260811 06:55:17.679230 17889 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53401
W20260811 06:55:17.679883 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17785: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:55:17.680024 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17785
2026-08-11T06:55:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2171 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:17 dist-test-slave-7lbf krb5kdc[17939](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:17 dist-test-slave-7lbf krb5kdc[17939](info): set up 2 sockets
Aug 11 06:55:17 dist-test-slave-7lbf krb5kdc[17939](info): commencing operation
krb5kdc: starting...
W20260811 06:55:18.963595 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:19 dist-test-slave-7lbf krb5kdc[17939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:55:19.288059 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43269
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:45885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:43269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:19.629040 17963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:19.629335 17963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:19.629484 17963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:19.636741 17963 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:19.636857 17963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:19.636941 17963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:19.637029 17963 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:19.637091 17963 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:19.647145 17963 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:45885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:43269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:43269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:19.648526 17963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:19.649955 17963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:19.661902 17970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:19.661857 17977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:19.661926 17973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:19.662554 17963 server_base.cc:1034] running on GCE node
I20260811 06:55:19.663379 17963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:19.664849 17963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:19.666050 17963 hybrid_clock.cc:648] HybridClock initialized: now 1786431319666002 us; error 40 us; skew 500 ppm
I20260811 06:55:19.666393 17963 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:19 dist-test-slave-7lbf krb5kdc[17939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:19.669497 17963 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:55:19.670989 17963 webserver.cc:460] Webserver started at http://127.12.145.62:33435/ using document root <none> and password file <none>
I20260811 06:55:19.671694 17963 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:19.671819 17963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:19.672122 17963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:19.675285 17963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "291919381e3948b9b07ec03940903588"
format_stamp: "Formatted at 2026-08-11 06:55:19 on dist-test-slave-7lbf"
server_key: "fb223eee1df9a14748a64321ad90548f"
server_key_iv: "4663822c7cdb653e2ccef0be9c2f4312"
server_key_version: "encryptionkey@0"
I20260811 06:55:19.676055 17963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "291919381e3948b9b07ec03940903588"
format_stamp: "Formatted at 2026-08-11 06:55:19 on dist-test-slave-7lbf"
server_key: "fb223eee1df9a14748a64321ad90548f"
server_key_iv: "4663822c7cdb653e2ccef0be9c2f4312"
server_key_version: "encryptionkey@0"
I20260811 06:55:19.681171 17963 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 06:55:19.684640 17987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:19.685988 17963 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 06:55:19.686157 17963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "291919381e3948b9b07ec03940903588"
format_stamp: "Formatted at 2026-08-11 06:55:19 on dist-test-slave-7lbf"
server_key: "fb223eee1df9a14748a64321ad90548f"
server_key_iv: "4663822c7cdb653e2ccef0be9c2f4312"
server_key_version: "encryptionkey@0"
I20260811 06:55:19.686344 17963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:19.692322 17963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:19.696627 17963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:19.696915 17963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:19.714301 17963 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:43269
I20260811 06:55:19.714336 18073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:43269 every 8 connection(s)
I20260811 06:55:19.715682 17963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:19.717866 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 17963
I20260811 06:55:19.718043 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:19.718489 12868 external_mini_cluster.cc:1428] Setting key d10814c437d38b6d628c690b87ba7ea5
I20260811 06:55:19.719633 18074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:19.725859 18080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:19.720125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37223 (local address 127.12.145.62:43269)
0811 06:55:19.720899 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:19.720911 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:19.720951 (+ 40us) server_negotiation.cc:407] Connection header received
0811 06:55:19.722567 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:19.722589 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:19.722931 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:19.723251 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:19.724254 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:19.724260 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:19.724272 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:19.724293 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:19.724362 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:19.724383 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:19.724547 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:19.724648 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 06:55:19.724879 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":361,"threads_started":1}
I20260811 06:55:19.729502 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:19.732072 18074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588: Bootstrap starting.
I20260811 06:55:19.735359 18074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:19.735987 18080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:19.733603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32975 (local address 127.12.145.62:43269)
0811 06:55:19.733743 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:19.733748 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:19.734180 (+ 432us) server_negotiation.cc:407] Connection header received
0811 06:55:19.734339 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:19.734343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:19.734388 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:19.734461 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:19.735339 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:19.735345 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:19.735353 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 06:55:19.735370 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:19.735409 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 06:55:19.735424 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:19.735538 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:19.735666 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 06:55:19.735714 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 06:55:19.736672 18074 log.cc:824] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:19.739476 18074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588: No bootstrap required, opened a new log
I20260811 06:55:19.746541 18074 raft_consensus.cc:348] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "291919381e3948b9b07ec03940903588" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43269 } }
I20260811 06:55:19.746869 18074 raft_consensus.cc:374] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:55:19.746963 18074 raft_consensus.cc:729] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 291919381e3948b9b07ec03940903588, State: Initialized, Role: FOLLOWER
I20260811 06:55:19.747490 18074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "291919381e3948b9b07ec03940903588" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43269 } }
I20260811 06:55:19.747694 18074 raft_consensus.cc:388] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 06:55:19.747821 18074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 06:55:19.747977 18074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:19.750377 18074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "291919381e3948b9b07ec03940903588" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43269 } }
I20260811 06:55:19.750883 18074 leader_election.cc:302] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 291919381e3948b9b07ec03940903588; no voters:
I20260811 06:55:19.751432 18074 leader_election.cc:288] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 06:55:19.751560 18089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:19.752177 18089 raft_consensus.cc:686] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [term 1 LEADER]: Becoming Leader. State: Replica: 291919381e3948b9b07ec03940903588, State: Running, Role: LEADER
I20260811 06:55:19.752676 18089 consensus_queue.cc:237] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "291919381e3948b9b07ec03940903588" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43269 } }
I20260811 06:55:19.753367 18074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:19.755455 18090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "291919381e3948b9b07ec03940903588" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "291919381e3948b9b07ec03940903588" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43269 } } }
I20260811 06:55:19.755765 18090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:19.756199 18091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 291919381e3948b9b07ec03940903588. Latest consensus state: current_term: 1 leader_uuid: "291919381e3948b9b07ec03940903588" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "291919381e3948b9b07ec03940903588" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 43269 } } }
I20260811 06:55:19.756486 18091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:19.757640 18099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:19.763099 18099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:55:19.772341 18099 catalog_manager.cc:1347] Generated new cluster ID: 38ade295386345018ecf47c2a66faafc
I20260811 06:55:19.772475 18099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:19.793411 18099 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:19.793936 18099 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:19.806597 18099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 291919381e3948b9b07ec03940903588: Generated new TSK 0
I20260811 06:55:19.807600 18099 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:19.813272 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17963
W20260811 06:55:19.814308 18068 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:37223
W20260811 06:55:19.814952 12868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 17963: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 06:55:19.815100 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 17963
2026-08-11T06:55:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2137 ms)
[----------] 18 tests from AuthTokenIssuingTest (39680 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:19 dist-test-slave-7lbf krb5kdc[18120](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:19 dist-test-slave-7lbf krb5kdc[18120](info): set up 2 sockets
Aug 11 06:55:19 dist-test-slave-7lbf krb5kdc[18120](info): commencing operation
krb5kdc: starting...
W20260811 06:55:21.087350 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:21 dist-test-slave-7lbf krb5kdc[18120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:55:21.420825 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:42375
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:45127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:42375,127.12.145.61:39405,127.12.145.60:35043
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:21.766314 18139 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 06:55:21.766670 18139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:21.766781 18139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:21.766904 18139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:21.774412 18139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:21.774510 18139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:21.774582 18139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:21.774667 18139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:21.774763 18139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:21.784919 18139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:45127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:42375,127.12.145.61:39405,127.12.145.60:35043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:42375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:21.786347 18139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:21.787719 18139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:21.799175 18148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:21.799304 18154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:21.799396 18149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:21.800597 18139 server_base.cc:1034] running on GCE node
I20260811 06:55:21.801481 18139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:21.802968 18139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:21.804203 18139 hybrid_clock.cc:648] HybridClock initialized: now 1786431321804133 us; error 35 us; skew 500 ppm
I20260811 06:55:21.804548 18139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:21 dist-test-slave-7lbf krb5kdc[18120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431321, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:21.807667 18139 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:55:21.809059 18139 webserver.cc:460] Webserver started at http://127.12.145.62:41739/ using document root <none> and password file <none>
I20260811 06:55:21.809774 18139 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:21.809876 18139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:21.810186 18139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:21.813113 18139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "86704e5e91e045b384a60509cada7fc0"
format_stamp: "Formatted at 2026-08-11 06:55:21 on dist-test-slave-7lbf"
server_key: "309c8a173d84c117048aaf05c460d237"
server_key_iv: "e1d21d0ded6a956ffa73a2164162115a"
server_key_version: "encryptionkey@0"
I20260811 06:55:21.813923 18139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "86704e5e91e045b384a60509cada7fc0"
format_stamp: "Formatted at 2026-08-11 06:55:21 on dist-test-slave-7lbf"
server_key: "309c8a173d84c117048aaf05c460d237"
server_key_iv: "e1d21d0ded6a956ffa73a2164162115a"
server_key_version: "encryptionkey@0"
I20260811 06:55:21.818863 18139 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260811 06:55:21.822280 18165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:21.823561 18139 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 06:55:21.823700 18139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "86704e5e91e045b384a60509cada7fc0"
format_stamp: "Formatted at 2026-08-11 06:55:21 on dist-test-slave-7lbf"
server_key: "309c8a173d84c117048aaf05c460d237"
server_key_iv: "e1d21d0ded6a956ffa73a2164162115a"
server_key_version: "encryptionkey@0"
I20260811 06:55:21.823876 18139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:21.846262 18139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:21.850111 18139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:21.850338 18139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:21.868242 18139 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:42375
I20260811 06:55:21.868263 18267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:42375 every 8 connection(s)
I20260811 06:55:21.869752 18139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:21.873070 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 18139
I20260811 06:55:21.873284 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:21.873719 18268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:21.874122 12868 external_mini_cluster.cc:1428] Setting key 1ab6a03d17aeeb3d2ea0852fee4af81d
I20260811 06:55:21.880399 18268 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:55:21 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431321, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:55:21.903787 18272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:21.884868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53046 (local address 127.12.145.62:42375)
0811 06:55:21.885646 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:21.885655 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:21.885720 (+ 65us) server_negotiation.cc:407] Connection header received
0811 06:55:21.887005 (+ 1285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:21.887025 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:21.887363 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:21.887605 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:21.889049 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:21.890338 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:21.892288 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:21.892843 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:21.892972 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:21.896933 (+ 3961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:21.896943 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:21.896957 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:21.896993 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:21.899623 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:21.900433 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:21.900447 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:21.900450 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:21.900598 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:21.901031 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:21.901034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:21.901036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:21.901586 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:21.901745 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:21.902372 (+ 627us) server_negotiation.cc:299] Negotiation successful
0811 06:55:21.902667 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":341,"threads_started":1}
I20260811 06:55:21.903832 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:21.883568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:42375 (local address 127.0.0.1:53046)
0811 06:55:21.884394 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:21.884451 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:21.886597 (+ 2146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:21.887608 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:21.887613 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:21.888300 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:21.888795 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:21.888820 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:21.890513 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:21.890518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:21.892149 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:21.892165 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:21.893091 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:21.893098 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:21.893275 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:21.893964 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:21.893993 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:21.896704 (+ 2711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:21.899765 (+ 3061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:21.899779 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:21.899792 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:21.900316 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:21.900721 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:21.900726 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:21.900730 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:21.900936 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:21.901728 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:21.901737 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:21.901995 (+ 258us) client_negotiation.cc:769] Sending connection context
0811 06:55:21.902277 (+ 282us) client_negotiation.cc:240] Negotiation successful
0811 06:55:21.902858 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":71,"thread_start_us":330,"threads_started":1}
I20260811 06:55:21.907159 18268 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.145.61@KRBTEST.COM; defaulting to no policy
I20260811 06:55:21.908138 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:21.907759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57078)
0811 06:55:21.907913 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:21.908031 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 06:55:21.908346 18166 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
I20260811 06:55:21.909770 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:21.909406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57094)
0811 06:55:21.909585 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:21.909650 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 06:55:21.909961 18268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:39405: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab.
Entry for principal kudu/127.12.145.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab.
I20260811 06:55:21.946436 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.61:39405
--webserver_interface=127.12.145.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab
--principal=kudu/127.12.145.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:45127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:42375,127.12.145.61:39405,127.12.145.60:35043
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:55:21.959287 18268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } attempt: 1
I20260811 06:55:21.960389 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:21.959946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57106)
0811 06:55:21.960138 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:21.960260 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 06:55:21.961447 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:21.961092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57122)
0811 06:55:21.961226 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:21.961301 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 06:55:21.961674 18268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:39405: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
I20260811 06:55:22.029898 18268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } attempt: 2
I20260811 06:55:22.031132 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.030661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57126)
0811 06:55:22.030896 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.030989 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 06:55:22.032179 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.031826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57142)
0811 06:55:22.031961 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.032043 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 06:55:22.032359 18268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:39405: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
I20260811 06:55:22.123586 18268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } attempt: 3
I20260811 06:55:22.124809 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.124372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57156)
0811 06:55:22.124576 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.124668 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 06:55:22.125826 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.125454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57170)
0811 06:55:22.125621 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.125690 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 06:55:22.126029 18268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:39405: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
I20260811 06:55:22.269264 18268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } attempt: 4
I20260811 06:55:22.270522 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.269995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57186)
0811 06:55:22.270295 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.270379 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
I20260811 06:55:22.271517 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.271178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57194)
0811 06:55:22.271310 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.271389 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 06:55:22.271703 18268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:39405: Network error: Client connection negotiation failed: client connection to 127.12.145.61:39405: connect: Connection refused (error 111)
W20260811 06:55:22.284941 18278 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 06:55:22.285238 18278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:22.285311 18278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:22.285390 18278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:22.292456 18278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:22.292538 18278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:22.292601 18278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:22.292651 18278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:22.292712 18278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:22.302251 18278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:45127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:42375,127.12.145.61:39405,127.12.145.60:35043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab
--principal=kudu/127.12.145.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.61:39405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.145.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:22.303429 18278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:22.304692 18278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:22.315656 18286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:22.315732 18291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:22.315709 18285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:22.316502 18278 server_base.cc:1034] running on GCE node
I20260811 06:55:22.317188 18278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:22.318503 18278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:22.319710 18278 hybrid_clock.cc:648] HybridClock initialized: now 1786431322319645 us; error 42 us; skew 500 ppm
I20260811 06:55:22.320007 18278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431322, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:22.323109 18278 init.cc:377] Logged in from keytab as kudu/127.12.145.61@KRBTEST.COM (short username kudu)
I20260811 06:55:22.324469 18278 webserver.cc:460] Webserver started at http://127.12.145.61:45923/ using document root <none> and password file <none>
I20260811 06:55:22.325126 18278 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:22.325217 18278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:22.325562 18278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:22.328545 18278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/data/instance:
uuid: "a90792f2594b433283d978fa4d2d70e6"
format_stamp: "Formatted at 2026-08-11 06:55:22 on dist-test-slave-7lbf"
server_key: "a12a71c9bdd0f4d59f87567bca7723de"
server_key_iv: "4e83d7a8eae54a330ca56fd426adf7be"
server_key_version: "encryptionkey@0"
I20260811 06:55:22.329310 18278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/wal/instance:
uuid: "a90792f2594b433283d978fa4d2d70e6"
format_stamp: "Formatted at 2026-08-11 06:55:22 on dist-test-slave-7lbf"
server_key: "a12a71c9bdd0f4d59f87567bca7723de"
server_key_iv: "4e83d7a8eae54a330ca56fd426adf7be"
server_key_version: "encryptionkey@0"
I20260811 06:55:22.334306 18278 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260811 06:55:22.337657 18305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:22.338883 18278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:55:22.339035 18278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/wal
uuid: "a90792f2594b433283d978fa4d2d70e6"
format_stamp: "Formatted at 2026-08-11 06:55:22 on dist-test-slave-7lbf"
server_key: "a12a71c9bdd0f4d59f87567bca7723de"
server_key_iv: "4e83d7a8eae54a330ca56fd426adf7be"
server_key_version: "encryptionkey@0"
I20260811 06:55:22.339226 18278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:22.352155 18278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:22.355827 18278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:22.356061 18278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:22.372988 18278 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.61:39405
I20260811 06:55:22.372996 18388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.61:39405 every 8 connection(s)
I20260811 06:55:22.374715 18278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
I20260811 06:55:22.377776 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 18278
I20260811 06:55:22.377978 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-1/wal/instance
I20260811 06:55:22.378520 12868 external_mini_cluster.cc:1428] Setting key 8b005be397fadeffb5ad7c51e05d09f4
I20260811 06:55:22.378804 18389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:22.387368 18389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431322, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:55:22.407265 18272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.390602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53054 (local address 127.12.145.62:42375)
0811 06:55:22.390819 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:22.390825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:22.391904 (+ 1079us) server_negotiation.cc:407] Connection header received
0811 06:55:22.393810 (+ 1906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:22.393816 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:22.393895 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:22.393983 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:22.395476 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.396148 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.397668 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.398091 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.398204 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.401768 (+ 3564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:22.401773 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:22.401776 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:22.401810 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:22.404313 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.405021 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.405025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.405027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.405147 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.405581 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.405585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.405587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.405863 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:22.406007 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:22.406685 (+ 678us) server_negotiation.cc:299] Negotiation successful
0811 06:55:22.406931 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 06:55:22.408178 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.390934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:42375 (local address 127.0.0.1:53054)
0811 06:55:22.391724 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.391778 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:22.393540 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:22.394230 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:22.394238 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:22.394735 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:22.395298 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.395316 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.396300 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.396304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.397484 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.397497 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.398308 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.398316 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.398534 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.399169 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:22.399191 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:22.401474 (+ 2283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:22.404452 (+ 2978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.404462 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.404478 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.404894 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.405250 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.405255 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.405259 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.405449 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.405993 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:22.406001 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:22.406327 (+ 326us) client_negotiation.cc:769] Sending connection context
0811 06:55:22.406563 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 06:55:22.407048 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":336,"threads_started":1}
WARNING: no policy specified for kudu/127.12.145.60@KRBTEST.COM; defaulting to no policy
I20260811 06:55:22.409919 18389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.60@KRBTEST.COM" created.
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431322, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
I20260811 06:55:22.423506 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.410508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57208)
0811 06:55:22.410708 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.410725 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:22.410806 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:22.411865 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:22.411890 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:22.412290 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:22.412417 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.412425 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.413765 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.413769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.414597 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.414608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.415380 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.415385 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.415566 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.416085 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:22.416101 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:22.418168 (+ 2067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:22.421094 (+ 2926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.421099 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.421103 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.421457 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.421800 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.421805 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.421809 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.421945 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.422507 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:22.422511 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:22.422655 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 06:55:22.422770 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 06:55:22.423111 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 06:55:22.423590 18395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.410805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57208 (local address 127.12.145.61:39405)
0811 06:55:22.411420 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:22.411426 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:22.411462 (+ 36us) server_negotiation.cc:407] Connection header received
0811 06:55:22.411513 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:22.411522 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:22.411694 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:22.411828 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:22.412572 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.413646 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.414721 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.415250 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.415355 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.418411 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:22.418427 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:22.418444 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:22.418505 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:22.420981 (+ 2476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.421584 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.421592 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.421596 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.421704 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.422039 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.422044 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.422048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.422383 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:22.422558 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:22.422917 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 06:55:22.423225 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":462,"thread_start_us":320,"threads_started":1}
I20260811 06:55:22.425734 18389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:55:22.426735 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.426309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59018)
0811 06:55:22.426480 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.426592 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 06:55:22.426955 18312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
I20260811 06:55:22.428500 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.428148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59024)
0811 06:55:22.428314 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.428382 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260811 06:55:22.428718 18389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:35043: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab.
Entry for principal kudu/127.12.145.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab.
I20260811 06:55:22.448407 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.60:35043
--webserver_interface=127.12.145.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab
--principal=kudu/127.12.145.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:45127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:42375,127.12.145.61:39405,127.12.145.60:35043
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:55:22.478055 18389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } attempt: 1
I20260811 06:55:22.479420 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.478838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59038)
0811 06:55:22.479085 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.479222 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 06:55:22.481207 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.480791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59052)
0811 06:55:22.480959 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.481059 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 06:55:22.481420 18389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:35043: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
I20260811 06:55:22.549661 18389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } attempt: 2
I20260811 06:55:22.550882 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.550336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59058)
0811 06:55:22.550569 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.550687 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 06:55:22.551910 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.551529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59062)
0811 06:55:22.551676 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.551762 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 06:55:22.552109 18389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:35043: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
I20260811 06:55:22.570925 18268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } attempt: 5
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431321, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
I20260811 06:55:22.588574 18395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.571730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57214 (local address 127.12.145.61:39405)
0811 06:55:22.571911 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:22.571916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:22.571937 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:55:22.572116 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:22.572120 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:22.572182 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:22.572266 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:22.573254 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.574031 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.575681 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.576086 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.576204 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.583508 (+ 7304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:22.583515 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:22.583518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:22.583551 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:22.586047 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.586821 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.586824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.586827 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.586973 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.587363 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.587366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.587368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.587639 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:22.587747 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:22.588198 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 06:55:22.588363 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 06:55:22.588721 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.571587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57214)
0811 06:55:22.571812 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.571835 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:22.571976 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:22.572327 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:22.572332 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:22.572847 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:22.573095 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.573109 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.574171 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.574177 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.575532 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.575550 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.576227 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.576233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.576444 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.580716 (+ 4272us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:22.580740 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:22.583286 (+ 2546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:22.586182 (+ 2896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.586187 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.586192 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.586717 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.587080 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.587085 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.587088 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.587261 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.587758 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:22.587763 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:22.587946 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 06:55:22.588101 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 06:55:22.588379 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 06:55:22.589821 18268 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:55:22.590902 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.590412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59072)
0811 06:55:22.590632 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.590736 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 06:55:22.591907 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.591531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59074)
0811 06:55:22.591688 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.591788 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 06:55:22.592144 18268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:35043: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
I20260811 06:55:22.643356 18389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } attempt: 3
I20260811 06:55:22.643356 18268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } attempt: 1
I20260811 06:55:22.644651 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.644081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59076)
0811 06:55:22.644331 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.644442 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 06:55:22.644799 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.644353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59084)
0811 06:55:22.644540 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.644636 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 06:55:22.645828 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.645388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59100)
0811 06:55:22.645602 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.645690 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 06:55:22.645937 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.645540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59108)
0811 06:55:22.645750 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.645824 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260811 06:55:22.646165 18389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:35043: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
W20260811 06:55:22.646203 18268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:35043: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
I20260811 06:55:22.714401 18268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } attempt: 2
I20260811 06:55:22.715694 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.715050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59112)
0811 06:55:22.715298 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.715418 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 06:55:22.716871 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.716474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59126)
0811 06:55:22.716640 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.716733 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 06:55:22.717115 18268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:35043: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
W20260811 06:55:22.784781 18401 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 06:55:22.785128 18401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:22.785231 18401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:22.785344 18401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 06:55:22.789389 18389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } attempt: 4
I20260811 06:55:22.791465 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.790275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59136)
0811 06:55:22.791134 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.791252 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":640}
I20260811 06:55:22.792384 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.792095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59140)
0811 06:55:22.792209 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.792275 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 06:55:22.792574 18389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:35043: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
W20260811 06:55:22.794826 18401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:22.794904 18401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:22.794997 18401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:22.795055 18401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:22.795138 18401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:22.804932 18401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:45127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:42375,127.12.145.61:39405,127.12.145.60:35043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab
--principal=kudu/127.12.145.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.60:35043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.145.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:22.806205 18401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:22.807493 18401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:22.818394 18409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:22.818455 18414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:22.818572 18408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:22.819820 18401 server_base.cc:1034] running on GCE node
I20260811 06:55:22.820506 18401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:22.821767 18401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:22.822974 18401 hybrid_clock.cc:648] HybridClock initialized: now 1786431322822918 us; error 26 us; skew 500 ppm
I20260811 06:55:22.823290 18401 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:55:22.823325 18268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } attempt: 3
I20260811 06:55:22.824541 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.823933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59144)
0811 06:55:22.824274 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.824353 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260811 06:55:22.825678 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.825239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59150)
0811 06:55:22.825424 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.825539 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260811 06:55:22.825912 18268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:35043: Network error: Client connection negotiation failed: client connection to 127.12.145.60:35043: connect: Connection refused (error 111)
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431322, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:22.826894 18401 init.cc:377] Logged in from keytab as kudu/127.12.145.60@KRBTEST.COM (short username kudu)
I20260811 06:55:22.828397 18401 webserver.cc:460] Webserver started at http://127.12.145.60:34861/ using document root <none> and password file <none>
I20260811 06:55:22.829068 18401 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:22.829169 18401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:22.829474 18401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:22.832445 18401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/data/instance:
uuid: "e15fd4964092461b9a2c28b4d729d0b4"
format_stamp: "Formatted at 2026-08-11 06:55:22 on dist-test-slave-7lbf"
server_key: "57df00148c490c799b66a494c2505a12"
server_key_iv: "10e655baff609802c483632a3401b067"
server_key_version: "encryptionkey@0"
I20260811 06:55:22.833210 18401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/wal/instance:
uuid: "e15fd4964092461b9a2c28b4d729d0b4"
format_stamp: "Formatted at 2026-08-11 06:55:22 on dist-test-slave-7lbf"
server_key: "57df00148c490c799b66a494c2505a12"
server_key_iv: "10e655baff609802c483632a3401b067"
server_key_version: "encryptionkey@0"
I20260811 06:55:22.838266 18401 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 06:55:22.841595 18423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:22.842913 18401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 06:55:22.843075 18401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/wal
uuid: "e15fd4964092461b9a2c28b4d729d0b4"
format_stamp: "Formatted at 2026-08-11 06:55:22 on dist-test-slave-7lbf"
server_key: "57df00148c490c799b66a494c2505a12"
server_key_iv: "10e655baff609802c483632a3401b067"
server_key_version: "encryptionkey@0"
I20260811 06:55:22.843263 18401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:22.874228 18401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:22.879391 18401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:22.879626 18401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:22.896927 18401 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.60:35043
I20260811 06:55:22.896952 18524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.60:35043 every 8 connection(s)
I20260811 06:55:22.898283 18401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
I20260811 06:55:22.898964 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 18401
I20260811 06:55:22.899134 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786430925511755-12868-0/minicluster-data/master-2/wal/instance
I20260811 06:55:22.899705 12868 external_mini_cluster.cc:1428] Setting key 7df52a3ea6632653b14c8ebee87a7038
I20260811 06:55:22.902570 18525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:22.910672 18525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431322, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:55:22.923367 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.901488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59154 (local address 127.12.145.60:35043)
0811 06:55:22.902253 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:22.902264 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:22.902305 (+ 41us) server_negotiation.cc:407] Connection header received
0811 06:55:22.903946 (+ 1641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:22.903969 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:22.904321 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:22.904625 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:22.906364 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.907736 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.909624 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.910281 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.910404 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.915411 (+ 5007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:22.915420 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:22.915433 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:22.915485 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:22.919093 (+ 3608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.919837 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.919843 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.919850 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.919999 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.920399 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.920404 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.920407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.921070 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:22.921377 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:22.921732 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 06:55:22.922167 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":328,"threads_started":1}
I20260811 06:55:22.929284 18532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.913508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:42375 (local address 127.0.0.1:53058)
0811 06:55:22.914288 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.914354 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:22.914508 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:22.915334 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:22.915342 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:22.916197 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:22.916550 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.916564 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.917760 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.917766 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.919372 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.919382 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.920200 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.920204 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.920343 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.920878 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:22.920900 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:22.923408 (+ 2508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:22.926746 (+ 3338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.926757 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.926764 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.927209 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.927592 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.927597 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.927599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.927769 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.928286 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:22.928293 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:22.928510 (+ 217us) client_negotiation.cc:769] Sending connection context
0811 06:55:22.928706 (+ 196us) client_negotiation.cc:240] Negotiation successful
0811 06:55:22.929004 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":298,"threads_started":1}
I20260811 06:55:22.929392 18533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.913617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53058 (local address 127.12.145.62:42375)
0811 06:55:22.914936 (+ 1319us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:22.914952 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:22.914973 (+ 21us) server_negotiation.cc:407] Connection header received
0811 06:55:22.915037 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:22.915042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:22.915118 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:22.915231 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:22.916694 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.917605 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.919499 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.920035 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.920160 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.923628 (+ 3468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:22.923635 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:22.923639 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:22.923679 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:22.926578 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.927319 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.927325 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.927329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.927490 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.927869 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.927872 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.927874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.928161 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:22.928271 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:22.928788 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 06:55:22.928945 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1184,"thread_start_us":1077,"threads_started":1}
I20260811 06:55:22.930609 18525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431322, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
I20260811 06:55:22.941715 18534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.926807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53060 (local address 127.12.145.62:42375)
0811 06:55:22.927416 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:22.927420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:22.927449 (+ 29us) server_negotiation.cc:407] Connection header received
0811 06:55:22.927490 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:22.927495 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:22.927554 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:22.927636 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:22.929061 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.930221 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.931656 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.932246 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.932365 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.936487 (+ 4122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:22.936494 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:22.936499 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:22.936535 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:22.939268 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.939859 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.939865 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.939869 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.939995 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.940330 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.940336 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.940339 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.940593 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:22.940842 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:22.941113 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 06:55:22.941314 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":314,"threads_started":1}
I20260811 06:55:22.943533 18532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.931183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:39405 (local address 127.0.0.1:57222)
0811 06:55:22.931333 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.931351 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:22.931454 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:22.931875 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:22.931880 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:22.932297 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:22.932484 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.932496 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.933770 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.933775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.934683 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.934698 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.935657 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.935663 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.935790 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.936237 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:22.936253 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:22.938549 (+ 2296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:22.941240 (+ 2691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.941245 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.941249 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.941656 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.942051 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.942054 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.942056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.942192 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.942722 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:22.942727 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:22.942887 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 06:55:22.943007 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 06:55:22.943218 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 06:55:22.943691 18395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.931408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57222 (local address 127.12.145.61:39405)
0811 06:55:22.931611 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:22.931618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:22.931637 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:55:22.931694 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:22.931698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:22.931755 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:22.931840 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:22.932630 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.933641 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.934849 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.935485 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.935612 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.938722 (+ 3110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:22.938727 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:22.938730 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:22.938763 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:22.941121 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.941766 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.941770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.941772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.941942 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.942349 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.942353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.942355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.942616 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:22.942754 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:22.943126 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 06:55:22.943302 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 06:55:22.944934 18525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
Aug 11 06:55:22 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431322, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
I20260811 06:55:22.957635 18395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.943484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57232 (local address 127.12.145.61:39405)
0811 06:55:22.943913 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:22.943919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:22.943937 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:55:22.943985 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:22.943990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:22.944238 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:22.944346 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:22.945798 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.946731 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.947864 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.948471 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.948593 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.952637 (+ 4044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:22.952644 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:22.952649 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:22.952685 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:22.955166 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.955787 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.955791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.955793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.955917 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.956270 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.956273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.956275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.956542 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:22.956787 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:22.957051 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 06:55:22.957247 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":1075,"threads_started":1}
I20260811 06:55:22.957788 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.945758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.12.145.60:35043)
0811 06:55:22.945926 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:22.945931 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:22.946066 (+ 135us) server_negotiation.cc:407] Connection header received
0811 06:55:22.946169 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:22.946173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:22.946239 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:22.946331 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:22.947121 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.947814 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.949176 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.949620 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.949717 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.952744 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:22.952748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:22.952751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:22.952780 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:22.955180 (+ 2400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.955783 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.955788 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.955792 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.955923 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:22.956265 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:22.956271 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:22.956274 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:22.956541 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:22.956667 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:22.957073 (+ 406us) server_negotiation.cc:299] Negotiation successful
0811 06:55:22.957441 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":114,"server-negotiator.queue_time_us":44}
I20260811 06:55:22.957827 18532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:22.945839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59170)
0811 06:55:22.945987 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:22.946005 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:22.946094 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:22.946366 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:22.946369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:22.946690 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:22.946820 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.946828 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.947914 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.947919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.949055 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:22.949067 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:22.949769 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:22.949775 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:22.949948 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:22.950401 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:22.950416 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:22.952581 (+ 2165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:22.955311 (+ 2730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.955316 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.955319 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.955669 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.956032 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:22.956037 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:22.956040 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:22.956159 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:22.956657 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:22.956661 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:22.956811 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 06:55:22.956960 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 06:55:22.957249 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 06:55:22.962330 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:22.962940 18525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4: Bootstrap starting.
I20260811 06:55:22.966044 18525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:22.967048 18525 log.cc:824] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:22.964824 18212 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "86704e5e91e045b384a60509cada7fc0"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53060
I20260811 06:55:22.969637 18525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4: No bootstrap required, opened a new log
I20260811 06:55:22.976745 18525 raft_consensus.cc:348] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } }
I20260811 06:55:22.977046 18525 raft_consensus.cc:729] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e15fd4964092461b9a2c28b4d729d0b4, State: Initialized, Role: FOLLOWER
I20260811 06:55:22.977451 18525 consensus_queue.cc:260] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } }
I20260811 06:55:22.978374 18537 sys_catalog.cc:455] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } } }
I20260811 06:55:22.978785 18537 sys_catalog.cc:458] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:22.979269 18525 sys_catalog.cc:564] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 06:55:22.988343 18549 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:55:22.988531 18549 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:55:22.986101 18401 master_runner.cc:186] Error getting master registration for 127.12.145.62:42375: OK, instance_id { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" instance_seqno: 1786431321862679 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 06:55:22.997098 18401 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 06:55:23.003132 18268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } attempt: 4
Aug 11 06:55:23 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431321, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
I20260811 06:55:23.019419 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:23.003883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59176)
0811 06:55:23.004111 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:23.004133 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:23.004269 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:23.004638 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:23.004643 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:23.005189 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:23.005411 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:23.005424 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.006878 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.006885 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:23.008363 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:23.008381 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.009385 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.009392 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:23.009650 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:23.010314 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:23.010339 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:23.013240 (+ 2901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:23.016940 (+ 3700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:23.016945 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:23.016950 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:23.017313 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:23.017717 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:23.017722 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:23.017727 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:23.017862 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:23.018443 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:23.018448 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:23.018627 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 06:55:23.018749 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 06:55:23.019044 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 06:55:23.019425 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:23.004070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59176 (local address 127.12.145.60:35043)
0811 06:55:23.004270 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.004276 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.004299 (+ 23us) server_negotiation.cc:407] Connection header received
0811 06:55:23.004396 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.004401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.004475 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.004572 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.005586 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.006735 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.008513 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.009230 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.009348 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:23.013430 (+ 4082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:23.013435 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:23.013438 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:23.013478 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:23.016798 (+ 3320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:23.017433 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:23.017439 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:23.017443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:23.017611 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:23.017969 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:23.017975 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:23.017978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:23.018309 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:23.018477 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:23.018862 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 06:55:23.019052 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 06:55:23.025775 18268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0: Bootstrap starting.
I20260811 06:55:23.030130 18268 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:23.031513 18268 log.cc:824] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:23.035020 18268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0: No bootstrap required, opened a new log
I20260811 06:55:23.042604 18268 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } }
I20260811 06:55:23.043030 18268 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86704e5e91e045b384a60509cada7fc0, State: Initialized, Role: FOLLOWER
I20260811 06:55:23.043555 18268 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } }
I20260811 06:55:23.044549 18556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } } }
I20260811 06:55:23.045003 18556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:23.045961 18268 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:23.046010 18212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 06:55:23.046201 18212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:23.048760 18212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } }
I20260811 06:55:23.050273 18212 leader_election.cc:288] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [CANDIDATE]: Term 1 election: Requested vote from peers a90792f2594b433283d978fa4d2d70e6 (127.12.145.61:39405), e15fd4964092461b9a2c28b4d729d0b4 (127.12.145.60:35043)
I20260811 06:55:23.051167 18485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86704e5e91e045b384a60509cada7fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e15fd4964092461b9a2c28b4d729d0b4"
I20260811 06:55:23.051684 18485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:23.055285 18485 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86704e5e91e045b384a60509cada7fc0 in term 1.
I20260811 06:55:23.055997 18174 leader_election.cc:302] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86704e5e91e045b384a60509cada7fc0, e15fd4964092461b9a2c28b4d729d0b4; no voters:
I20260811 06:55:23.056456 18556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:23.065817 18556 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [term 1 LEADER]: Becoming Leader. State: Replica: 86704e5e91e045b384a60509cada7fc0, State: Running, Role: LEADER
I20260811 06:55:23.066659 18556 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } }
I20260811 06:55:23.091741 18389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } attempt: 5
I20260811 06:55:23.096493 18534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:23.055311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53076 (local address 127.12.145.62:42375)
0811 06:55:23.055544 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.055551 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.066370 (+ 10819us) server_negotiation.cc:407] Connection header received
0811 06:55:23.066899 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.066906 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.067002 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.067083 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.069727 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.070915 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.073045 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.073773 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.073873 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:23.081301 (+ 7428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:23.081309 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:23.081315 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:23.081365 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:23.085272 (+ 3907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:23.093420 (+ 8148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:23.093427 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:23.093432 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:23.093653 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:23.094469 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:23.094476 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:23.094479 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:23.094865 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:23.095119 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:23.095783 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 06:55:23.096051 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 06:55:23.099551 18575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86704e5e91e045b384a60509cada7fc0. Latest consensus state: current_term: 1 leader_uuid: "86704e5e91e045b384a60509cada7fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } } }
I20260811 06:55:23.100055 18575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [sys.catalog]: This master's current role is: LEADER
W20260811 06:55:23.103035 18180 tablet.cc:2369] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:55:23.110520 18584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:23.120898 18584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 06:55:23 dist-test-slave-7lbf krb5kdc[18120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431322, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
W20260811 06:55:23.132342 18442 tablet.cc:2369] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:55:23.140599 18485 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [term 1 FOLLOWER]: Refusing update from remote peer 86704e5e91e045b384a60509cada7fc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:55:23.142118 18575 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:55:23.153257 18395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:23.058887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57236 (local address 127.12.145.61:39405)
0811 06:55:23.059064 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.059070 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.086182 (+ 27112us) server_negotiation.cc:407] Connection header received
0811 06:55:23.086947 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.086954 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.087043 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.087119 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.105525 (+ 18406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.106596 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.123140 (+ 16544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.123814 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.123909 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:23.132585 (+ 8676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:23.132591 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:23.132596 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:23.132636 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:23.136109 (+ 3473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:23.149721 (+ 13612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:23.149728 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:23.149732 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:23.149950 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:23.150740 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:23.150747 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:23.150751 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:23.151212 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:23.151453 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:23.152498 (+ 1045us) server_negotiation.cc:299] Negotiation successful
0811 06:55:23.152879 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 06:55:23.158645 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:23.058096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59184 (local address 127.12.145.60:35043)
0811 06:55:23.058293 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.058300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.086302 (+ 28002us) server_negotiation.cc:407] Connection header received
0811 06:55:23.087346 (+ 1044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.087352 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.087451 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.087519 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.104200 (+ 16681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.105306 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.124169 (+ 18863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.124914 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.125022 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:23.129933 (+ 4911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:23.129939 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:23.129944 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:23.129986 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:23.152343 (+ 22357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:23.155128 (+ 2785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:23.155134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:23.155138 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:23.155288 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:23.155921 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:23.155930 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:23.155933 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:23.156313 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:23.156572 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:23.157652 (+ 1080us) server_negotiation.cc:299] Negotiation successful
0811 06:55:23.158046 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 06:55:23.166826 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:23.092379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:35043 (local address 127.0.0.1:59196)
0811 06:55:23.092734 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:23.092751 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:23.092844 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:23.101072 (+ 8228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:23.101077 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:23.101618 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:23.101818 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:23.101831 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.110104 (+ 8273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.110111 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:23.111537 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:23.111554 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.116763 (+ 5209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.116771 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:23.118248 (+ 1477us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:23.119013 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:23.119038 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:23.121899 (+ 2861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:23.161647 (+ 39748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:23.161652 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:23.161656 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:23.162238 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:23.164578 (+ 2340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:23.164583 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:23.164586 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:23.164762 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:23.165841 (+ 1079us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:23.165846 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:23.166027 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 06:55:23.166165 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 06:55:23.166461 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237}
I20260811 06:55:23.168850 18582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:23.093054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59196 (local address 127.12.145.60:35043)
0811 06:55:23.100735 (+ 7681us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.100741 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.100764 (+ 23us) server_negotiation.cc:407] Connection header received
0811 06:55:23.100819 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.100824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.100901 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.101014 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.102105 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.109575 (+ 7470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.112449 (+ 2874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:23.116260 (+ 3811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:23.122502 (+ 6242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:23.125974 (+ 3472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:23.126142 (+ 168us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:23.126151 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:23.126356 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:23.160992 (+ 34636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:23.164093 (+ 3101us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:23.164102 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:23.164106 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:23.164380 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:23.164952 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:23.164957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:23.164960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:23.165632 (+ 672us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:23.167486 (+ 1854us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:23.167721 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 06:55:23.168120 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7543,"thread_start_us":7350,"threads_started":1}
I20260811 06:55:23.175132 18389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6: Bootstrap starting.
I20260811 06:55:23.181047 18389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:23.182574 18389 log.cc:824] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:23.184242 18537 sys_catalog.cc:455] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86704e5e91e045b384a60509cada7fc0. Latest consensus state: current_term: 1 leader_uuid: "86704e5e91e045b384a60509cada7fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } } }
I20260811 06:55:23.184609 18537 sys_catalog.cc:458] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:23.194139 18556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "86704e5e91e045b384a60509cada7fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } } }
I20260811 06:55:23.194494 18556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:23.198076 18537 sys_catalog.cc:455] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "86704e5e91e045b384a60509cada7fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } } }
I20260811 06:55:23.198342 18537 sys_catalog.cc:458] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:23.208683 18389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6: No bootstrap required, opened a new log
I20260811 06:55:23.208855 18584 catalog_manager.cc:1347] Generated new cluster ID: c58e5267a7484473a3dfce9a3669f22a
I20260811 06:55:23.208962 18584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:23.220412 18389 raft_consensus.cc:348] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } }
I20260811 06:55:23.220995 18389 raft_consensus.cc:729] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a90792f2594b433283d978fa4d2d70e6, State: Initialized, Role: FOLLOWER
I20260811 06:55:23.221597 18389 consensus_queue.cc:260] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } }
I20260811 06:55:23.230556 18389 sys_catalog.cc:564] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:23.230659 18351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86704e5e91e045b384a60509cada7fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a90792f2594b433283d978fa4d2d70e6"
I20260811 06:55:23.231242 18351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:23.233692 18595 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 06:55:23.234807 18351 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86704e5e91e045b384a60509cada7fc0 in term 1.
I20260811 06:55:23.235778 18350 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [term 1 FOLLOWER]: Refusing update from remote peer 86704e5e91e045b384a60509cada7fc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:55:23.235848 18602 sys_catalog.cc:455] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } } }
I20260811 06:55:23.236272 18602 sys_catalog.cc:458] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:23.237211 18575 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:55:23.256983 18584 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:23.259848 18584 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:23.269587 18556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "86704e5e91e045b384a60509cada7fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } } }
I20260811 06:55:23.269904 18556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:23.270377 18602 sys_catalog.cc:455] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86704e5e91e045b384a60509cada7fc0. Latest consensus state: current_term: 1 leader_uuid: "86704e5e91e045b384a60509cada7fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } } }
I20260811 06:55:23.270721 18602 sys_catalog.cc:458] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:23.275336 18614 sys_catalog.cc:455] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "86704e5e91e045b384a60509cada7fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86704e5e91e045b384a60509cada7fc0" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 42375 } } peers { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 39405 } } peers { permanent_uuid: "e15fd4964092461b9a2c28b4d729d0b4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 35043 } } }
I20260811 06:55:23.276459 18614 sys_catalog.cc:458] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:23.251411 18139 master_runner.cc:186] Error getting master registration for 127.12.145.61:39405: OK, instance_id { permanent_uuid: "a90792f2594b433283d978fa4d2d70e6" instance_seqno: 1786431322368104 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 06:55:23.280761 18139 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 06:55:23.297703 18584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86704e5e91e045b384a60509cada7fc0: Generated new TSK 0
I20260811 06:55:23.298951 18584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:23.325214 18627 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260811 06:55:23.423691 18534 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.415205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53090 (local address 127.12.145.62:42375)
0811 06:55:23.415405 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.415411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.421356 (+ 5945us) server_negotiation.cc:407] Connection header received
0811 06:55:23.421899 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.421906 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.422028 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.422110 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.423370 (+ 1260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53090: BlockingRecv error: recv got EOF from 127.0.0.1:53090 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 06:55:23.426105 18582 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.414312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59198 (local address 127.12.145.60:35043)
0811 06:55:23.415039 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.415045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.424368 (+ 9323us) server_negotiation.cc:407] Connection header received
0811 06:55:23.424644 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.424650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.424754 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.424831 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.425848 (+ 1017us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59198: BlockingRecv error: recv got EOF from 127.0.0.1:59198 (error 108)
Metrics: {"server-negotiator.queue_time_us":565}
W20260811 06:55:23.428586 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.426244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57240 (local address 127.12.145.61:39405)
0811 06:55:23.426462 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.426468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.427097 (+ 629us) server_negotiation.cc:407] Connection header received
0811 06:55:23.427385 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.427392 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.427477 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.427585 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.428377 (+ 792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57240: BlockingRecv error: recv got EOF from 127.0.0.1:57240 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 06:55:23.442024 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.439637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57256 (local address 127.12.145.61:39405)
0811 06:55:23.439816 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.439823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.440359 (+ 536us) server_negotiation.cc:407] Connection header received
0811 06:55:23.440617 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.440623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.440760 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.440882 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.441732 (+ 850us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57256: BlockingRecv error: recv got EOF from 127.0.0.1:57256 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 06:55:23.463951 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.455820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57262 (local address 127.12.145.61:39405)
0811 06:55:23.456027 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.456034 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.462236 (+ 6202us) server_negotiation.cc:407] Connection header received
0811 06:55:23.462455 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.462461 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.462568 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.462701 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.463704 (+ 1003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57262: BlockingRecv error: recv got EOF from 127.0.0.1:57262 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 06:55:23.471484 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.469243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57274 (local address 127.12.145.61:39405)
0811 06:55:23.469433 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.469439 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.469998 (+ 559us) server_negotiation.cc:407] Connection header received
0811 06:55:23.470190 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.470195 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.470296 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.470404 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.471238 (+ 834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57274: BlockingRecv error: recv got EOF from 127.0.0.1:57274 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 06:55:23.489573 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.487198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57280 (local address 127.12.145.61:39405)
0811 06:55:23.487423 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.487430 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.487999 (+ 569us) server_negotiation.cc:407] Connection header received
0811 06:55:23.488213 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.488220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.488325 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.488452 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.489297 (+ 845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57280: BlockingRecv error: recv got EOF from 127.0.0.1:57280 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
W20260811 06:55:23.505919 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.503614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57286 (local address 127.12.145.61:39405)
0811 06:55:23.503807 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.503814 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.504341 (+ 527us) server_negotiation.cc:407] Connection header received
0811 06:55:23.504538 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.504543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.504635 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.504740 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.505663 (+ 923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57286: BlockingRecv error: recv got EOF from 127.0.0.1:57286 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 06:55:23.528019 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.525624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57290 (local address 127.12.145.61:39405)
0811 06:55:23.525834 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.525841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.526409 (+ 568us) server_negotiation.cc:407] Connection header received
0811 06:55:23.526615 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.526622 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.526713 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.526815 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.527740 (+ 925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57290: BlockingRecv error: recv got EOF from 127.0.0.1:57290 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 06:55:23.566184 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.564164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57300 (local address 127.12.145.61:39405)
0811 06:55:23.564381 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.564388 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.564718 (+ 330us) server_negotiation.cc:407] Connection header received
0811 06:55:23.564900 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.564907 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.565019 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.565153 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.565901 (+ 748us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57300: BlockingRecv error: recv got EOF from 127.0.0.1:57300 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260811 06:55:23.635653 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.633502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57314 (local address 127.12.145.61:39405)
0811 06:55:23.633733 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.633740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.634095 (+ 355us) server_negotiation.cc:407] Connection header received
0811 06:55:23.634327 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.634333 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.634430 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.634557 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.635438 (+ 881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57314: BlockingRecv error: recv got EOF from 127.0.0.1:57314 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 06:55:23.772823 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:23.771016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57330 (local address 127.12.145.61:39405)
0811 06:55:23.771214 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:23.771219 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:23.771556 (+ 337us) server_negotiation.cc:407] Connection header received
0811 06:55:23.771727 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:23.771731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:23.771813 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:23.771907 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:23.772584 (+ 677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57330: BlockingRecv error: recv got EOF from 127.0.0.1:57330 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 06:55:23.990624 18549 catalog_manager.cc:1259] Loaded cluster ID: c58e5267a7484473a3dfce9a3669f22a
I20260811 06:55:23.990736 18549 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4: loading cluster ID for follower catalog manager: success
I20260811 06:55:23.993203 18549 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4: acquiring CA information for follower catalog manager: success
I20260811 06:55:23.994980 18549 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e15fd4964092461b9a2c28b4d729d0b4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 06:55:24.034976 18395 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:24.033119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57340 (local address 127.12.145.61:39405)
0811 06:55:24.033337 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:24.033344 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:24.033539 (+ 195us) server_negotiation.cc:407] Connection header received
0811 06:55:24.033775 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:24.033779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:24.033852 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:24.033939 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:24.034715 (+ 776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57340: BlockingRecv error: recv got EOF from 127.0.0.1:57340 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 06:55:24.329888 18627 catalog_manager.cc:1259] Loaded cluster ID: c58e5267a7484473a3dfce9a3669f22a
I20260811 06:55:24.330001 18627 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6: loading cluster ID for follower catalog manager: success
I20260811 06:55:24.332700 18627 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6: acquiring CA information for follower catalog manager: success
I20260811 06:55:24.334561 18627 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a90792f2594b433283d978fa4d2d70e6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 06:55:24.562022 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:24.554935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57346 (local address 127.12.145.61:39405)
0811 06:55:24.555756 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:24.555761 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:24.555780 (+ 19us) server_negotiation.cc:407] Connection header received
0811 06:55:24.555844 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:24.555848 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:24.555992 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:24.556104 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:24.556605 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:24.557498 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:24.559537 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:24.559991 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:24.560082 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:24.560743 (+ 661us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:24.561298 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:24.561420 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:24.561584 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 06:55:24.561652 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":548,"threads_started":1}
I20260811 06:55:24.574291 18759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:24.568005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59210 (local address 127.12.145.60:35043)
0811 06:55:24.568579 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:24.568584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:24.568600 (+ 16us) server_negotiation.cc:407] Connection header received
0811 06:55:24.568690 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:24.568693 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:24.568836 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:24.568977 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:24.569432 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:24.570173 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:24.572045 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:24.572425 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:24.572524 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:24.573071 (+ 547us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:24.573656 (+ 585us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:24.573763 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:24.573894 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 06:55:24.573962 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":359,"threads_started":1}
I20260811 06:55:24.602031 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:24.580579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53096 (local address 127.12.145.62:42375)
0811 06:55:24.592752 (+ 12173us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:24.592760 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:24.593383 (+ 623us) server_negotiation.cc:407] Connection header received
0811 06:55:24.593549 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:24.593556 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:24.593806 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:24.594647 (+ 841us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:24.594827 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:24.595959 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:24.598728 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:24.599379 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:24.600044 (+ 665us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:24.600248 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:24.600738 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:24.601467 (+ 729us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:24.601561 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 06:55:24.601704 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12018,"thread_start_us":11882,"threads_started":1}
I20260811 06:55:24.604018 18759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:24.580651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59224 (local address 127.12.145.60:35043)
0811 06:55:24.580816 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:24.580823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:24.596847 (+ 16024us) server_negotiation.cc:407] Connection header received
0811 06:55:24.597271 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:24.597276 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:24.597367 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:24.597423 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:24.598360 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:24.599397 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:24.601869 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:24.602498 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:24.602597 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:24.603207 (+ 610us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:24.603345 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:24.603417 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:24.603634 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 06:55:24.603718 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 06:55:24.604674 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:24.593409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57348 (local address 127.12.145.61:39405)
0811 06:55:24.593625 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:24.593631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:24.597172 (+ 3541us) server_negotiation.cc:407] Connection header received
0811 06:55:24.597427 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:24.597433 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:24.597540 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:24.597613 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:24.598599 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:24.599641 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:24.601888 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:24.602537 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:24.602616 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:24.603823 (+ 1207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:24.603946 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:24.604008 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:24.604243 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 06:55:24.604335 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 06:55:24.609093 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18139
I20260811 06:55:24.610060 18261 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:55:24.720721 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 18139
I20260811 06:55:24.751163 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18278
I20260811 06:55:24.752321 18378 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:55:24.861479 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 18278
I20260811 06:55:24.890921 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18401
I20260811 06:55:24.892041 18517 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:55:24.997691 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 18401
2026-08-11T06:55:25Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5180 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 06:55:25 dist-test-slave-7lbf krb5kdc[18780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 06:55:25 dist-test-slave-7lbf krb5kdc[18780](info): set up 2 sockets
Aug 11 06:55:25 dist-test-slave-7lbf krb5kdc[18780](info): commencing operation
krb5kdc: starting...
W20260811 06:55:26.266824 12868 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/test-user.keytab.
Aug 11 06:55:26 dist-test-slave-7lbf krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T06:55:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:55:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
Entry for principal kudu/127.12.145.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab.
I20260811 06:55:26.577003 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:39883
--webserver_interface=127.12.145.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:37449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:39883,127.12.145.61:41183,127.12.145.60:36321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 06:55:26.916369 18802 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 06:55:26.916673 18802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:26.916777 18802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:26.916931 18802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:26.924211 18802 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:26.924324 18802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:26.924404 18802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:26.924455 18802 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:26.924516 18802 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:26.933984 18802 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:39883,127.12.145.61:41183,127.12.145.60:36321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.62.keytab
--principal=kudu/127.12.145.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.62:39883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:26.935207 18802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:26.936457 18802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:26.947552 18813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:26.947576 18812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:26.947621 18816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:26.948307 18802 server_base.cc:1034] running on GCE node
I20260811 06:55:26.948964 18802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:26.950301 18802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:26.951529 18802 hybrid_clock.cc:648] HybridClock initialized: now 1786431326951446 us; error 55 us; skew 500 ppm
I20260811 06:55:26.951853 18802 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:26 dist-test-slave-7lbf krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431326, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:26.954916 18802 init.cc:377] Logged in from keytab as kudu/127.12.145.62@KRBTEST.COM (short username kudu)
I20260811 06:55:26.956254 18802 webserver.cc:460] Webserver started at http://127.12.145.62:41991/ using document root <none> and password file <none>
I20260811 06:55:26.956897 18802 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:26.956997 18802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:26.957310 18802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:26.960165 18802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/data/instance:
uuid: "3f593b9f91c04b668b33a832c6693e15"
format_stamp: "Formatted at 2026-08-11 06:55:26 on dist-test-slave-7lbf"
server_key: "83861a9d230f70653ff8a3a5c5cac0bf"
server_key_iv: "b5b3c75f2678e984b4360b654e5d0abb"
server_key_version: "encryptionkey@0"
I20260811 06:55:26.960930 18802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/wal/instance:
uuid: "3f593b9f91c04b668b33a832c6693e15"
format_stamp: "Formatted at 2026-08-11 06:55:26 on dist-test-slave-7lbf"
server_key: "83861a9d230f70653ff8a3a5c5cac0bf"
server_key_iv: "b5b3c75f2678e984b4360b654e5d0abb"
server_key_version: "encryptionkey@0"
I20260811 06:55:26.965828 18802 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 06:55:26.969130 18825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:26.970412 18802 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 06:55:26.970597 18802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/wal
uuid: "3f593b9f91c04b668b33a832c6693e15"
format_stamp: "Formatted at 2026-08-11 06:55:26 on dist-test-slave-7lbf"
server_key: "83861a9d230f70653ff8a3a5c5cac0bf"
server_key_iv: "b5b3c75f2678e984b4360b654e5d0abb"
server_key_version: "encryptionkey@0"
I20260811 06:55:26.970803 18802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:27.023113 18802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:27.027107 18802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:27.027364 18802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:27.044732 18802 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.62:39883
I20260811 06:55:27.044754 18903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.62:39883 every 8 connection(s)
I20260811 06:55:27.046095 18802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/data/info.pb
I20260811 06:55:27.049799 18904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:27.056396 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 18802
I20260811 06:55:27.056584 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-0/wal/instance
I20260811 06:55:27.056212 18904 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:55:27.057116 12868 external_mini_cluster.cc:1428] Setting key a9ac30b709255a4f15d2898fefe0ea95
Aug 11 06:55:27 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431326, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:55:27.080979 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.059813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:39883 (local address 127.0.0.1:34022)
0811 06:55:27.062059 (+ 2246us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.062114 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:27.064304 (+ 2190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:27.065130 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:27.065137 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:27.065867 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:27.066295 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:27.066330 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.067859 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.067864 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:27.069372 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:27.069387 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.070329 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.070336 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:27.070493 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:27.071151 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:27.071177 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:27.073659 (+ 2482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:27.076980 (+ 3321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:27.076991 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:27.077003 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:27.077382 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:27.077790 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:27.077795 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:27.077799 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:27.077951 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:27.078687 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:27.078695 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:27.078910 (+ 215us) client_negotiation.cc:769] Sending connection context
0811 06:55:27.079121 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 06:55:27.079686 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1975,"mutex_wait_us":115,"thread_start_us":1745,"threads_started":1}
I20260811 06:55:27.081014 18908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.059813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34022 (local address 127.12.145.62:39883)
0811 06:55:27.062966 (+ 3153us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:27.062972 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:27.063021 (+ 49us) server_negotiation.cc:407] Connection header received
0811 06:55:27.064664 (+ 1643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:27.064669 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:27.064902 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:27.065058 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:27.066524 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.067704 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.069508 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.070088 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.070222 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:27.073899 (+ 3677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:27.073911 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:27.073926 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:27.073962 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:27.076865 (+ 2903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:27.077505 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:27.077530 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:27.077534 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:27.077689 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:27.078066 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:27.078069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:27.078071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:27.078554 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:27.078743 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:27.079249 (+ 506us) server_negotiation.cc:299] Negotiation successful
0811 06:55:27.079535 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2971,"thread_start_us":2708,"threads_started":1}
I20260811 06:55:27.083876 18904 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:55:27.084964 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.084592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51844)
0811 06:55:27.084742 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.084849 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 06:55:27.085237 18828 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
I20260811 06:55:27.086753 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.086423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51846)
0811 06:55:27.086567 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.086637 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 06:55:27.086930 18904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:41183: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.145.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab.
Entry for principal kudu/127.12.145.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab.
I20260811 06:55:27.126441 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.61:41183
--webserver_interface=127.12.145.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab
--principal=kudu/127.12.145.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:37449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:39883,127.12.145.61:41183,127.12.145.60:36321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:55:27.136245 18904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } attempt: 1
I20260811 06:55:27.137467 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.136999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51854)
0811 06:55:27.137194 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.137306 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 06:55:27.138412 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.138098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51868)
0811 06:55:27.138211 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.138279 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 06:55:27.138617 18904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:41183: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
I20260811 06:55:27.206904 18904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } attempt: 2
I20260811 06:55:27.208156 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.207655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51884)
0811 06:55:27.207899 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.208021 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 06:55:27.209174 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.208809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51892)
0811 06:55:27.208962 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.209046 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 06:55:27.209363 18904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:41183: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
I20260811 06:55:27.300592 18904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } attempt: 3
I20260811 06:55:27.301774 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.301320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51902)
0811 06:55:27.301537 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.301638 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 06:55:27.302759 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.302409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51912)
0811 06:55:27.302556 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.302623 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 06:55:27.302953 18904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:41183: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
I20260811 06:55:27.446223 18904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } attempt: 4
I20260811 06:55:27.447470 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.446926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51914)
0811 06:55:27.447244 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.447330 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
I20260811 06:55:27.448468 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.448128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51916)
0811 06:55:27.448272 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.448340 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 06:55:27.448654 18904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.61:41183: Network error: Client connection negotiation failed: client connection to 127.12.145.61:41183: connect: Connection refused (error 111)
W20260811 06:55:27.467361 18914 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 06:55:27.467706 18914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:27.467823 18914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:27.467952 18914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:27.475577 18914 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:27.475683 18914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:27.475775 18914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:27.475858 18914 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:27.475952 18914 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:27.485949 18914 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:39883,127.12.145.61:41183,127.12.145.60:36321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.61.keytab
--principal=kudu/127.12.145.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.61:41183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.145.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:27.487260 18914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:27.488756 18914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:27.501407 18927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:27.501442 18924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:27.501341 18934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:27.502501 18914 server_base.cc:1034] running on GCE node
I20260811 06:55:27.503281 18914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:27.504632 18914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:27.505885 18914 hybrid_clock.cc:648] HybridClock initialized: now 1786431327505813 us; error 41 us; skew 500 ppm
I20260811 06:55:27.506233 18914 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:27 dist-test-slave-7lbf krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431327, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:27.509299 18914 init.cc:377] Logged in from keytab as kudu/127.12.145.61@KRBTEST.COM (short username kudu)
I20260811 06:55:27.510761 18914 webserver.cc:460] Webserver started at http://127.12.145.61:45023/ using document root <none> and password file <none>
I20260811 06:55:27.511421 18914 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:27.511521 18914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:27.511826 18914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:27.514768 18914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/data/instance:
uuid: "4b9e2f2068074228a3f27c286dc3615e"
format_stamp: "Formatted at 2026-08-11 06:55:27 on dist-test-slave-7lbf"
server_key: "ecbecb5b7a7a9d3fdebaea35eb8c00fb"
server_key_iv: "07a0bf7d3ab145995c3b6c5337abd9e9"
server_key_version: "encryptionkey@0"
I20260811 06:55:27.515535 18914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/wal/instance:
uuid: "4b9e2f2068074228a3f27c286dc3615e"
format_stamp: "Formatted at 2026-08-11 06:55:27 on dist-test-slave-7lbf"
server_key: "ecbecb5b7a7a9d3fdebaea35eb8c00fb"
server_key_iv: "07a0bf7d3ab145995c3b6c5337abd9e9"
server_key_version: "encryptionkey@0"
I20260811 06:55:27.520498 18914 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260811 06:55:27.523829 18949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:27.525084 18914 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 06:55:27.525239 18914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/wal
uuid: "4b9e2f2068074228a3f27c286dc3615e"
format_stamp: "Formatted at 2026-08-11 06:55:27 on dist-test-slave-7lbf"
server_key: "ecbecb5b7a7a9d3fdebaea35eb8c00fb"
server_key_iv: "07a0bf7d3ab145995c3b6c5337abd9e9"
server_key_version: "encryptionkey@0"
I20260811 06:55:27.525434 18914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:27.550354 18914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:27.554173 18914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:27.554428 18914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:27.571863 18914 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.61:41183
I20260811 06:55:27.571887 19036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.61:41183 every 8 connection(s)
I20260811 06:55:27.573199 18914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/data/info.pb
I20260811 06:55:27.576948 19037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:27.577179 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 18914
I20260811 06:55:27.577343 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-1/wal/instance
I20260811 06:55:27.577826 12868 external_mini_cluster.cc:1428] Setting key c694e1715050b715f490c01fc1a62ad1
I20260811 06:55:27.583369 19037 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:55:27 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431327, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.60@KRBTEST.COM; defaulting to no policy
I20260811 06:55:27.609886 19040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.585804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34026 (local address 127.12.145.62:39883)
0811 06:55:27.586326 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:27.586333 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:27.587265 (+ 932us) server_negotiation.cc:407] Connection header received
0811 06:55:27.589591 (+ 2326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:27.589595 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:27.589663 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:27.589753 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:27.591636 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.592734 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.594258 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.594845 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.594981 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:27.604216 (+ 9235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:27.604222 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:27.604225 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:27.604266 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:27.606855 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:27.607743 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:27.607747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:27.607749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:27.607864 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:27.608281 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:27.608284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:27.608286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:27.608597 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:27.608710 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:27.609389 (+ 679us) server_negotiation.cc:299] Negotiation successful
0811 06:55:27.609624 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":261,"threads_started":1}
I20260811 06:55:27.610833 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.586331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:39883 (local address 127.0.0.1:34026)
0811 06:55:27.587083 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.587139 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:27.589297 (+ 2158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:27.590009 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:27.590019 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:27.590730 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:27.591442 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:27.591466 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.592884 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.592888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:27.594118 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:27.594132 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.595045 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.595050 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:27.595253 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:27.601487 (+ 6234us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:27.601543 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:27.603953 (+ 2410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:27.607012 (+ 3059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:27.607021 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:27.607039 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:27.607636 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:27.607960 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:27.607965 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:27.607968 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:27.608188 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:27.608716 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:27.608722 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:27.609047 (+ 325us) client_negotiation.cc:769] Sending connection context
0811 06:55:27.609291 (+ 244us) client_negotiation.cc:240] Negotiation successful
0811 06:55:27.609724 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":275,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.60@KRBTEST.COM" created.
I20260811 06:55:27.612645 19037 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:55:27 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431327, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
I20260811 06:55:27.628027 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.613406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:51922)
0811 06:55:27.613616 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.613634 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:27.613732 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:27.615852 (+ 2120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:27.615857 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:27.616263 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:27.616436 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:27.616447 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.617815 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.617821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:27.618937 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:27.618951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.619715 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.619720 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:27.619894 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:27.620393 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:27.620413 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:27.622591 (+ 2178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:27.625595 (+ 3004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:27.625600 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:27.625603 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:27.626059 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:27.626393 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:27.626397 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:27.626400 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:27.626574 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:27.627145 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:27.627149 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:27.627282 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 06:55:27.627412 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 06:55:27.627670 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 06:55:27.628057 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.613696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51922 (local address 127.12.145.61:41183)
0811 06:55:27.615460 (+ 1764us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:27.615465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:27.615489 (+ 24us) server_negotiation.cc:407] Connection header received
0811 06:55:27.615529 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:27.615535 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:27.615696 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:27.615800 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:27.616600 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.617687 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.619062 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.619572 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.619661 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:27.622790 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:27.622804 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:27.622818 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:27.622857 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:27.625451 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:27.626170 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:27.626177 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:27.626179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:27.626294 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:27.626686 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:27.626689 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:27.626691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:27.627019 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:27.627181 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:27.627542 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 06:55:27.627766 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":1618,"thread_start_us":1486,"threads_started":1}
I20260811 06:55:27.630806 19037 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:55:27.631877 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.631362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33518)
0811 06:55:27.631528 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.631686 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 06:55:27.632134 18951 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
I20260811 06:55:27.633636 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.633242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33534)
0811 06:55:27.633406 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.633501 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 06:55:27.633860 19037 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:36321: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab.
Entry for principal kudu/127.12.145.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab.
I20260811 06:55:27.648700 12868 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
/tmp/dist-test-taskuXC_ag/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.60:36321
--webserver_interface=127.12.145.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab
--principal=kudu/127.12.145.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.20:37449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.62:39883,127.12.145.61:41183,127.12.145.60:36321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 06:55:27.683231 19037 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } attempt: 1
I20260811 06:55:27.684523 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.683949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33540)
0811 06:55:27.684188 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.684321 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 06:55:27.685482 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.685110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33548)
0811 06:55:27.685260 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.685348 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 06:55:27.685746 19037 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:36321: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
I20260811 06:55:27.747866 18904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } attempt: 5
I20260811 06:55:27.753952 19037 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } attempt: 2
I20260811 06:55:27.754966 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.754503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33558)
0811 06:55:27.754689 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.754787 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
Aug 11 06:55:27 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431326, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
I20260811 06:55:27.756079 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.755647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33570)
0811 06:55:27.755855 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.755941 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 06:55:27.756369 19037 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:36321: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
I20260811 06:55:27.761327 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.748796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56930 (local address 127.12.145.61:41183)
0811 06:55:27.748981 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:27.748987 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:27.749011 (+ 24us) server_negotiation.cc:407] Connection header received
0811 06:55:27.749128 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:27.749134 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:27.749216 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:27.749324 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:27.750090 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.751208 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.752350 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.753023 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.753165 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:27.756451 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:27.756457 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:27.756462 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:27.756512 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:27.758960 (+ 2448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:27.759557 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:27.759561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:27.759563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:27.759676 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:27.760030 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:27.760034 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:27.760036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:27.760300 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:27.760430 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:27.760809 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 06:55:27.761040 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 06:55:27.761329 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.748646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:56930)
0811 06:55:27.748864 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.748886 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:27.749008 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:27.749339 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:27.749342 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:27.749750 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:27.749932 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:27.749941 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.751338 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.751342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:27.752197 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:27.752209 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:27.753153 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:27.753157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:27.753296 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:27.753923 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:27.753946 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:27.756284 (+ 2338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:27.759085 (+ 2801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:27.759090 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:27.759095 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:27.759444 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:27.759780 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:27.759785 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:27.759789 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:27.759917 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:27.760414 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:27.760419 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:27.760568 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 06:55:27.760686 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 06:55:27.760994 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 06:55:27.762377 18904 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:55:27.763302 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.762966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33574)
0811 06:55:27.763113 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.763179 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 06:55:27.764180 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.763898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33584)
0811 06:55:27.764023 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.764087 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 06:55:27.764382 18904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:36321: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
I20260811 06:55:27.815593 18904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } attempt: 1
I20260811 06:55:27.816807 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.816346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33594)
0811 06:55:27.816540 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.816641 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 06:55:27.817765 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.817411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33608)
0811 06:55:27.817578 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.817656 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 06:55:27.817962 18904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:36321: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
I20260811 06:55:27.847617 19037 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } attempt: 3
I20260811 06:55:27.848935 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.848327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33618)
0811 06:55:27.848590 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.848718 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 06:55:27.850112 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.849618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33626)
0811 06:55:27.849864 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.849970 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
W20260811 06:55:27.850344 19037 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:36321: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
I20260811 06:55:27.886168 18904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } attempt: 2
I20260811 06:55:27.887274 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.886791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33628)
0811 06:55:27.887019 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.887108 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 06:55:27.888294 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.888007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33638)
0811 06:55:27.888124 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.888194 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 06:55:27.888492 18904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:36321: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
W20260811 06:55:27.980885 19053 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 06:55:27.981199 19053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:55:27.981269 19053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:55:27.981349 19053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:55:27.988629 19053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:55:27.988720 19053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 06:55:27.988775 19053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:55:27.988822 19053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:55:27.988880 19053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:55:27.993561 19037 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } attempt: 4
I20260811 06:55:27.994735 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.994171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33648)
0811 06:55:27.994423 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.994543 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 06:55:27.994689 18904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } attempt: 3
I20260811 06:55:27.995692 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.995216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33658)
0811 06:55:27.995415 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.995520 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 06:55:27.996354 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.996019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33662)
0811 06:55:27.996176 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.996251 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 06:55:27.996619 19037 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:36321: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
I20260811 06:55:27.996770 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:27.996316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33676)
0811 06:55:27.996538 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:27.996635 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260811 06:55:27.996956 18904 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.60:36321: Network error: Client connection negotiation failed: client connection to 127.12.145.60:36321: connect: Connection refused (error 111)
I20260811 06:55:27.999564 19053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.20:37449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.62:39883,127.12.145.61:41183,127.12.145.60:36321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/krb5kdc/kudu_127.12.145.60.keytab
--principal=kudu/127.12.145.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.60:36321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.145.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:57:29 UTC on ccycloud.quasar-vkgtjh.root.comops.site
build id 4579822
ASAN enabled
I20260811 06:55:28.000823 19053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:55:28.002195 19053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:55:28.013717 19060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:28.013942 19066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:55:28.013724 19061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:55:28.014876 19053 server_base.cc:1034] running on GCE node
I20260811 06:55:28.015591 19053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:55:28.016878 19053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:55:28.018087 19053 hybrid_clock.cc:648] HybridClock initialized: now 1786431328018021 us; error 35 us; skew 500 ppm
I20260811 06:55:28.018389 19053 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 06:55:28 dist-test-slave-7lbf krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431328, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 06:55:28.021417 19053 init.cc:377] Logged in from keytab as kudu/127.12.145.60@KRBTEST.COM (short username kudu)
I20260811 06:55:28.022861 19053 webserver.cc:460] Webserver started at http://127.12.145.60:40263/ using document root <none> and password file <none>
I20260811 06:55:28.023619 19053 fs_manager.cc:359] Metadata directory not provided
I20260811 06:55:28.023725 19053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:55:28.024027 19053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:55:28.026923 19053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/data/instance:
uuid: "cf3c729145034f8abb52f8f928abb1c4"
format_stamp: "Formatted at 2026-08-11 06:55:28 on dist-test-slave-7lbf"
server_key: "e8eb28a432a78b3cdd5d1651a1626318"
server_key_iv: "ea396d3da8f6549c31297de7dcb75ee0"
server_key_version: "encryptionkey@0"
I20260811 06:55:28.027686 19053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/wal/instance:
uuid: "cf3c729145034f8abb52f8f928abb1c4"
format_stamp: "Formatted at 2026-08-11 06:55:28 on dist-test-slave-7lbf"
server_key: "e8eb28a432a78b3cdd5d1651a1626318"
server_key_iv: "ea396d3da8f6549c31297de7dcb75ee0"
server_key_version: "encryptionkey@0"
I20260811 06:55:28.032764 19053 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 06:55:28.036108 19083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:55:28.037292 19053 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 06:55:28.037469 19053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/data,/tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/wal
uuid: "cf3c729145034f8abb52f8f928abb1c4"
format_stamp: "Formatted at 2026-08-11 06:55:28 on dist-test-slave-7lbf"
server_key: "e8eb28a432a78b3cdd5d1651a1626318"
server_key_iv: "ea396d3da8f6549c31297de7dcb75ee0"
server_key_version: "encryptionkey@0"
I20260811 06:55:28.037703 19053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:55:28.048611 19053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:55:28.052511 19053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:55:28.052718 19053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:55:28.069551 19053 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.60:36321
I20260811 06:55:28.069577 19182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.60:36321 every 8 connection(s)
I20260811 06:55:28.070916 19053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/data/info.pb
I20260811 06:55:28.074680 19184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:55:28.079576 12868 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu as pid 19053
I20260811 06:55:28.079770 12868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuXC_ag/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786430925511755-12868-0/minicluster-data/master-2/wal/instance
I20260811 06:55:28.080307 12868 external_mini_cluster.cc:1428] Setting key c2c1028e188da116f7773c7b8b484932
I20260811 06:55:28.081930 19184 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:55:28 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431328, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
Aug 11 06:55:28 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
I20260811 06:55:28.098876 19040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.084467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49506 (local address 127.12.145.62:39883)
0811 06:55:28.084650 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.084656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.085339 (+ 683us) server_negotiation.cc:407] Connection header received
0811 06:55:28.085689 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.085694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.085771 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.085849 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.087070 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.087751 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.089217 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.089658 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.089767 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.092996 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.093001 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.093004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.093042 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.095484 (+ 2442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.096400 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.096404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.096407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.096546 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.097039 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.097045 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.097047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.097404 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.097573 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.098321 (+ 748us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.098517 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 06:55:28.100069 19191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.084462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.62:39883 (local address 127.0.0.1:49506)
0811 06:55:28.085197 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:28.085248 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:28.085540 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:28.085944 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:28.085951 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:28.086533 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:28.086886 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:28.086903 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.087902 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.087906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:28.089067 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:28.089080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.089880 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.089888 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:28.090023 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.090647 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:28.090686 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:28.092803 (+ 2117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:28.095616 (+ 2813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:28.095626 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:28.095638 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:28.096292 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:28.096660 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:28.096665 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:28.096669 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:28.096917 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:28.097537 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:28.097546 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:28.097911 (+ 365us) client_negotiation.cc:769] Sending connection context
0811 06:55:28.098229 (+ 318us) client_negotiation.cc:240] Negotiation successful
0811 06:55:28.098714 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"spinlock_wait_cycles":32256,"thread_start_us":329,"threads_started":1}
I20260811 06:55:28.100088 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.082135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33690 (local address 127.12.145.60:36321)
0811 06:55:28.082908 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.082920 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.082960 (+ 40us) server_negotiation.cc:407] Connection header received
0811 06:55:28.084695 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.084722 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.085114 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.085413 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.086841 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.087988 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.089188 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.089744 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.089903 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.093678 (+ 3775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.093689 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.093704 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.093745 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.096725 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.097456 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.097464 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.097468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.097642 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.097996 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.098001 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.098003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.098408 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.098702 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.099041 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.099286 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"spinlock_wait_cycles":1920,"thread_start_us":355,"threads_started":1}
I20260811 06:55:28.101706 19184 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 06:55:28 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431328, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
Aug 11 06:55:28 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.62@KRBTEST.COM
I20260811 06:55:28.115906 19191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.102458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.61:41183 (local address 127.0.0.1:56934)
0811 06:55:28.102626 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:28.102644 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:28.102737 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:28.103021 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:28.103025 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:28.103443 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:28.103617 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:28.103629 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.104953 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.104956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:28.106302 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:28.106314 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.107170 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.107174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:28.107311 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.107819 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:28.107842 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:28.110288 (+ 2446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:28.113586 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:28.113591 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:28.113595 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:28.113942 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:28.114308 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:28.114313 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:28.114316 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:28.114496 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:28.114968 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:28.114973 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:28.115118 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 06:55:28.115243 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 06:55:28.115539 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 06:55:28.115927 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.102553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56934 (local address 127.12.145.61:41183)
0811 06:55:28.102749 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.102756 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.102776 (+ 20us) server_negotiation.cc:407] Connection header received
0811 06:55:28.102836 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.102842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.102901 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.102978 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.103764 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.104816 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.106425 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.107049 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.107175 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.110470 (+ 3295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.110476 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.110479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.110512 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.113446 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.114044 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.114048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.114050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.114187 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.114591 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.114595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.114597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.114849 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.114989 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.115369 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.115566 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:55:28.117038 19184 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:55:28.118948 19040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.103225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49516 (local address 127.12.145.62:39883)
0811 06:55:28.103383 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.103389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.103406 (+ 17us) server_negotiation.cc:407] Connection header received
0811 06:55:28.103481 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.103486 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.103557 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.103653 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.105053 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.106105 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.107586 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.108179 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.108304 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.112925 (+ 4621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.112931 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.112934 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.112965 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.115978 (+ 3013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.116876 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.116880 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.116882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.117013 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.117390 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.117394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.117396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.117732 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.118008 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.118518 (+ 510us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.118689 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 06:55:28 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431328, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.60@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
Aug 11 06:55:28 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.61@KRBTEST.COM
I20260811 06:55:28.129900 19191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.117739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33702)
0811 06:55:28.117921 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:28.117951 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:28.118046 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:28.118354 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:28.118359 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:28.118808 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:28.118994 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:28.119004 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.120118 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.120122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:28.121128 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:28.121141 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.122043 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.122047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:28.122218 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.122703 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:28.122720 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:28.124510 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:28.127397 (+ 2887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:28.127403 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:28.127407 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:28.127886 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:28.128236 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:28.128241 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:28.128245 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:28.128370 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:28.128893 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:28.128897 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:28.129047 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 06:55:28.129186 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 06:55:28.129478 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 06:55:28.129925 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.117986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33702 (local address 127.12.145.60:36321)
0811 06:55:28.118125 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.118129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.118143 (+ 14us) server_negotiation.cc:407] Connection header received
0811 06:55:28.118180 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.118183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.118233 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.118303 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.119128 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.119998 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.121245 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.121907 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.122043 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.124685 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.124691 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.124696 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.124732 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.127265 (+ 2533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.128005 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.128009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.128011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.128129 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.128468 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.128472 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.128476 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.128787 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.128916 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.129280 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.129648 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":136,"server-negotiator.queue_time_us":44}
I20260811 06:55:28.134553 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.120550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56944 (local address 127.12.145.61:41183)
0811 06:55:28.120706 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.120710 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.120746 (+ 36us) server_negotiation.cc:407] Connection header received
0811 06:55:28.120908 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.120913 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.120980 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.121056 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.122576 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.123249 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.124516 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.125139 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.125278 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.129472 (+ 4194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.129477 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.129480 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.129511 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.132142 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.132740 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.132745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.132747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.132877 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.133224 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.133227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.133230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.133501 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.133798 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.134046 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.134264 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 06:55:28.135326 19184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4: Bootstrap starting.
I20260811 06:55:28.139147 12868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 06:55:28.139143 19184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:28.140403 19184 log.cc:824] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:28.143575 19184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4: No bootstrap required, opened a new log
I20260811 06:55:28.142141 18863 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3f593b9f91c04b668b33a832c6693e15"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49516
I20260811 06:55:28.154112 19184 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } }
I20260811 06:55:28.154503 19184 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf3c729145034f8abb52f8f928abb1c4, State: Initialized, Role: FOLLOWER
I20260811 06:55:28.154992 19184 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } }
I20260811 06:55:28.155875 19193 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } } }
I20260811 06:55:28.156170 19193 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:28.156922 19184 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 06:55:28.165839 19208 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:55:28.165959 19208 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:55:28.164258 19053 master_runner.cc:186] Error getting master registration for 127.12.145.62:39883: OK, instance_id { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" instance_seqno: 1786431327039738 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 06:55:28.171751 19053 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 06:55:28.174098 18904 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } attempt: 4
Aug 11 06:55:28 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431326, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.62@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
I20260811 06:55:28.189379 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.174762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33712)
0811 06:55:28.175046 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:28.175065 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:28.175198 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:28.175600 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:28.175605 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:28.176123 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:28.176334 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:28.176347 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.177786 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.177792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:28.179283 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:28.179300 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.180348 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.180355 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:28.180560 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.181135 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:28.181158 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:28.183808 (+ 2650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:28.186992 (+ 3184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:28.186997 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:28.187002 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:28.187336 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:28.187683 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:28.187688 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:28.187692 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:28.187842 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:28.188461 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:28.188465 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:28.188606 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 06:55:28.188720 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 06:55:28.188990 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162}
I20260811 06:55:28.189385 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.174820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33712 (local address 127.12.145.60:36321)
0811 06:55:28.174990 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.174994 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.175123 (+ 129us) server_negotiation.cc:407] Connection header received
0811 06:55:28.175348 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.175353 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.175436 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.175545 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.176481 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.177635 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.179428 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.180186 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.180311 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.183996 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.184003 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.184011 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.184047 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.186863 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.187445 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.187451 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.187455 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.187575 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.187969 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.187974 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.187977 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.188336 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.188472 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.188836 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.189043 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 06:55:28.193986 18904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15: Bootstrap starting.
I20260811 06:55:28.197083 18904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:28.198366 18904 log.cc:824] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:28.201589 18904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15: No bootstrap required, opened a new log
I20260811 06:55:28.208850 18904 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } }
I20260811 06:55:28.209242 18904 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f593b9f91c04b668b33a832c6693e15, State: Initialized, Role: FOLLOWER
I20260811 06:55:28.209757 18904 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } }
I20260811 06:55:28.211112 19212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } } }
I20260811 06:55:28.211755 19212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:28.212157 18904 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:28.212229 18863 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 06:55:28.212407 18863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:28.215970 18863 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } }
I20260811 06:55:28.218616 19131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3f593b9f91c04b668b33a832c6693e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "cf3c729145034f8abb52f8f928abb1c4"
I20260811 06:55:28.219144 19131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:28.222620 19131 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f593b9f91c04b668b33a832c6693e15 in term 1.
I20260811 06:55:28.222674 18863 leader_election.cc:288] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [CANDIDATE]: Term 1 election: Requested vote from peers 4b9e2f2068074228a3f27c286dc3615e (127.12.145.61:41183), cf3c729145034f8abb52f8f928abb1c4 (127.12.145.60:36321)
W20260811 06:55:28.223145 19228 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:55:28.223320 19228 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:55:28.223342 18826 leader_election.cc:302] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f593b9f91c04b668b33a832c6693e15, cf3c729145034f8abb52f8f928abb1c4; no voters:
I20260811 06:55:28.242465 19212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:55:28.243650 19212 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [term 1 LEADER]: Becoming Leader. State: Replica: 3f593b9f91c04b668b33a832c6693e15, State: Running, Role: LEADER
I20260811 06:55:28.244251 19212 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } }
I20260811 06:55:28.228533 18802 master_runner.cc:186] Error getting master registration for 127.12.145.61:41183: OK, instance_id { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" instance_seqno: 1786431327566873 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 06:55:28.247072 18802 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 06:55:28.253072 19234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f593b9f91c04b668b33a832c6693e15. Latest consensus state: current_term: 1 leader_uuid: "3f593b9f91c04b668b33a832c6693e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } } }
I20260811 06:55:28.253890 19234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:28.266608 19244 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:55:28.270757 19244 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260811 06:55:28.280020 18831 tablet.cc:2369] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:55:28.293478 19131 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [term 1 FOLLOWER]: Refusing update from remote peer 3f593b9f91c04b668b33a832c6693e15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:55:28.294734 19234 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:55:28.295822 19037 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } attempt: 5
W20260811 06:55:28.305508 19091 tablet.cc:2369] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:55:28.321025 19040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.268993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49532 (local address 127.12.145.62:39883)
0811 06:55:28.269179 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.269186 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.274126 (+ 4940us) server_negotiation.cc:407] Connection header received
0811 06:55:28.281177 (+ 7051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.281184 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.281277 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.281352 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.283798 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.285019 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.286950 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.287702 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.287805 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.308450 (+ 20645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.308459 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.308463 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.308526 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.312253 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.313281 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.313288 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.313292 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.313457 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.313992 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.313998 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.314001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.314394 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.314679 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.320362 (+ 5683us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.320631 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 06:55:28.321353 19193 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f593b9f91c04b668b33a832c6693e15. Latest consensus state: current_term: 1 leader_uuid: "3f593b9f91c04b668b33a832c6693e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } } }
I20260811 06:55:28.321714 19193 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:28.327522 19255 mvcc.cc:205] Tried to move back new op lower bound from 7317222720674086912 to 7317222720508882944. Current Snapshot: MvccSnapshot[applied={T|T < 7317222720674086912}]
Aug 11 06:55:28 dist-test-slave-7lbf krb5kdc[18780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786431327, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.61@KRBTEST.COM for kudu/127.12.145.60@KRBTEST.COM
I20260811 06:55:28.334056 19212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3f593b9f91c04b668b33a832c6693e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } } }
I20260811 06:55:28.334419 19212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:28.341012 19244 catalog_manager.cc:1347] Generated new cluster ID: 1438abd0f6964a32a1e72c92224021ed
I20260811 06:55:28.341132 19244 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:55:28.348881 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.274586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56954 (local address 127.12.145.61:41183)
0811 06:55:28.274814 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.274821 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.289289 (+ 14468us) server_negotiation.cc:407] Connection header received
0811 06:55:28.292116 (+ 2827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.292123 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.292212 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.292282 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.303901 (+ 11619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.305118 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.318484 (+ 13366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.319268 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.319567 (+ 299us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.329359 (+ 9792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.329367 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.329371 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.329411 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.333263 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.342200 (+ 8937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.342207 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.342210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.342368 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.342879 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.342884 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.342887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.343300 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.343551 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.348268 (+ 4717us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.348531 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":160,"server-negotiator.queue_time_us":97}
I20260811 06:55:28.351708 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.296580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.60:36321 (local address 127.0.0.1:33742)
0811 06:55:28.296816 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 06:55:28.296833 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 06:55:28.296925 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:55:28.318614 (+ 21689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 06:55:28.318620 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 06:55:28.319158 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0811 06:55:28.319397 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:28.319410 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.322765 (+ 3355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.322771 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:28.324179 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 06:55:28.324196 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.325987 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.325994 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 06:55:28.326263 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.327015 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 06:55:28.327039 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 06:55:28.330138 (+ 3099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 06:55:28.339827 (+ 9689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:28.339832 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:28.339836 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:28.340392 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:28.341235 (+ 843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 06:55:28.341240 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 06:55:28.341243 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 06:55:28.341447 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 06:55:28.350680 (+ 9233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 06:55:28.350685 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 06:55:28.350853 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 06:55:28.351016 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 06:55:28.351309 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":3}
I20260811 06:55:28.352737 19256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.296869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33742 (local address 127.12.145.60:36321)
0811 06:55:28.318079 (+ 21210us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.318086 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.318109 (+ 23us) server_negotiation.cc:407] Connection header received
0811 06:55:28.318213 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.318219 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.318350 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.319790 (+ 1440us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.320327 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.322542 (+ 2215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.324512 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.325761 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.330455 (+ 4694us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.330877 (+ 422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.330886 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.330890 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.330955 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.339671 (+ 8716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.340869 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.340876 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.340880 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.341091 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.341660 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.341665 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.341668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.350179 (+ 8511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.351956 (+ 1777us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.352094 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.352326 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20997,"thread_start_us":22964,"threads_started":1}
I20260811 06:55:28.353714 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.276648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33726 (local address 127.12.145.60:36321)
0811 06:55:28.276809 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.276814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.295503 (+ 18689us) server_negotiation.cc:407] Connection header received
0811 06:55:28.301658 (+ 6155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.301664 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.301804 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.301884 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.315234 (+ 13350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.316390 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.326538 (+ 10148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.327124 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.327221 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.344561 (+ 17340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 06:55:28.344567 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 06:55:28.344572 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 06:55:28.344610 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 06:55:28.347969 (+ 3359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.350989 (+ 3020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.350995 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.350998 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.351138 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 06:55:28.351609 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 06:55:28.351613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 06:55:28.351616 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 06:55:28.351965 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 06:55:28.352210 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.353149 (+ 939us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.353362 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 06:55:28.365836 19037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e: Bootstrap starting.
I20260811 06:55:28.370150 19037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e: Neither blocks nor log segments found. Creating new log.
I20260811 06:55:28.370465 19193 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3f593b9f91c04b668b33a832c6693e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } } }
I20260811 06:55:28.370723 19193 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:28.371515 19037 log.cc:824] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e: Log is configured to *not* fsync() on all Append() calls
I20260811 06:55:28.378053 19244 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:55:28.380242 19244 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:55:28.388808 19037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e: No bootstrap required, opened a new log
I20260811 06:55:28.393663 19244 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15: Generated new TSK 0
I20260811 06:55:28.394721 19244 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:55:28.421116 19037 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } }
I20260811 06:55:28.422132 19037 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9e2f2068074228a3f27c286dc3615e, State: Initialized, Role: FOLLOWER
I20260811 06:55:28.425976 19037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } }
I20260811 06:55:28.438699 18998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3f593b9f91c04b668b33a832c6693e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4b9e2f2068074228a3f27c286dc3615e"
I20260811 06:55:28.439706 18995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:55:28.443548 18995 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [term 1 FOLLOWER]: Refusing update from remote peer 3f593b9f91c04b668b33a832c6693e15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:55:28.444967 19212 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:55:28.447243 19037 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:55:28.485281 19273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f593b9f91c04b668b33a832c6693e15. Latest consensus state: current_term: 1 leader_uuid: "3f593b9f91c04b668b33a832c6693e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } } }
I20260811 06:55:28.485822 19273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:28.486305 19287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3f593b9f91c04b668b33a832c6693e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } } }
I20260811 06:55:28.486373 19269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f593b9f91c04b668b33a832c6693e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } } }
I20260811 06:55:28.486759 19287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:28.486802 19269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:55:28.487339 18998 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f593b9f91c04b668b33a832c6693e15 for term 1 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260811 06:55:28.543289 19040 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:28.535242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49548 (local address 127.12.145.62:39883)
0811 06:55:28.535401 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.535407 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.541099 (+ 5692us) server_negotiation.cc:407] Connection header received
0811 06:55:28.541391 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.541398 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.541505 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.541612 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.543003 (+ 1391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49548: BlockingRecv error: recv got EOF from 127.0.0.1:49548 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 06:55:28.545058 19045 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:28.534829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56966 (local address 127.12.145.61:41183)
0811 06:55:28.535034 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.535040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.542610 (+ 7570us) server_negotiation.cc:407] Connection header received
0811 06:55:28.543634 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.543640 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.543721 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.543814 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.544821 (+ 1007us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56966: BlockingRecv error: recv got EOF from 127.0.0.1:56966 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 06:55:28.545181 19307 catalog_manager.cc:1259] Loaded cluster ID: 1438abd0f6964a32a1e72c92224021ed
I20260811 06:55:28.545295 19307 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e: loading cluster ID for follower catalog manager: success
W20260811 06:55:28.547529 19188 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:28.541179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33746 (local address 127.12.145.60:36321)
0811 06:55:28.541348 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.541354 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.543505 (+ 2151us) server_negotiation.cc:407] Connection header received
0811 06:55:28.546018 (+ 2513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.546023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.546106 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.546175 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.547272 (+ 1097us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33746: BlockingRecv error: recv got EOF from 127.0.0.1:33746 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 06:55:28.549150 19307 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e: acquiring CA information for follower catalog manager: success
I20260811 06:55:28.552347 19307 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4b9e2f2068074228a3f27c286dc3615e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 06:55:28.615248 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.599926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56982 (local address 127.12.145.61:41183)
0811 06:55:28.600137 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.600144 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.607508 (+ 7364us) server_negotiation.cc:407] Connection header received
0811 06:55:28.608034 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.608041 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.608223 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.608343 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:28.609082 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.610192 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.612171 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.612818 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.612916 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.613685 (+ 769us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:28.614374 (+ 689us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:28.614513 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.614777 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.614883 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
W20260811 06:55:28.668231 19188 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:28.665356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33754 (local address 127.12.145.60:36321)
0811 06:55:28.665641 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.665649 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.666167 (+ 518us) server_negotiation.cc:407] Connection header received
0811 06:55:28.666557 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.666565 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.666710 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.666798 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.667991 (+ 1193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33754: BlockingRecv error: recv got EOF from 127.0.0.1:33754 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 06:55:28.745365 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.723162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56992 (local address 127.12.145.61:41183)
0811 06:55:28.725361 (+ 2199us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.725369 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.738222 (+ 12853us) server_negotiation.cc:407] Connection header received
0811 06:55:28.738594 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.738600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.738712 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.738776 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:28.739512 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.740671 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.743032 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.743705 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.743808 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.744491 (+ 683us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:28.744671 (+ 180us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:28.744740 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.744995 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.745085 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2042}
W20260811 06:55:28.815649 19188 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:28.810630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33758 (local address 127.12.145.60:36321)
0811 06:55:28.810827 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.810839 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.814094 (+ 3255us) server_negotiation.cc:407] Connection header received
0811 06:55:28.814315 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.814321 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.814427 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.814531 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.815384 (+ 853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33758: BlockingRecv error: recv got EOF from 127.0.0.1:33758 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 06:55:28.838338 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.831612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57008 (local address 127.12.145.61:41183)
0811 06:55:28.831811 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.831819 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.833050 (+ 1231us) server_negotiation.cc:407] Connection header received
0811 06:55:28.833248 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.833252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.833323 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.833420 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:28.833921 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.834701 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.836624 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.837046 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.837131 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.837651 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:28.837760 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:28.837829 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.837959 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.838024 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 06:55:28.846179 19188 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:28.844349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33764 (local address 127.12.145.60:36321)
0811 06:55:28.844543 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.844549 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.844843 (+ 294us) server_negotiation.cc:407] Connection header received
0811 06:55:28.844994 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.845000 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.845096 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.845204 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.845947 (+ 743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33764: BlockingRecv error: recv got EOF from 127.0.0.1:33764 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 06:55:28.857790 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.852834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57024 (local address 127.12.145.61:41183)
0811 06:55:28.853016 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.853022 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.853269 (+ 247us) server_negotiation.cc:407] Connection header received
0811 06:55:28.853442 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.853446 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.853572 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.853661 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:28.854058 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.854823 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.856121 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.856608 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.856723 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.857101 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:28.857199 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:28.857273 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.857409 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.857488 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 06:55:28.865195 19188 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:28.863483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33768 (local address 127.12.145.60:36321)
0811 06:55:28.863734 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.863740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.863979 (+ 239us) server_negotiation.cc:407] Connection header received
0811 06:55:28.864121 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.864127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.864217 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.864322 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.864974 (+ 652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33768: BlockingRecv error: recv got EOF from 127.0.0.1:33768 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
I20260811 06:55:28.881670 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.876044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57040 (local address 127.12.145.61:41183)
0811 06:55:28.876220 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.876225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.876567 (+ 342us) server_negotiation.cc:407] Connection header received
0811 06:55:28.876738 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.876743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.876827 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.876927 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:28.877289 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.878433 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.879701 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.880368 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.880505 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.880850 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:28.880992 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:28.881101 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.881184 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.881271 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 06:55:28.889240 19188 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:28.887326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33780 (local address 127.12.145.60:36321)
0811 06:55:28.887519 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.887524 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.887839 (+ 315us) server_negotiation.cc:407] Connection header received
0811 06:55:28.888047 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.888052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.888157 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.888246 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.889034 (+ 788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33780: BlockingRecv error: recv got EOF from 127.0.0.1:33780 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 06:55:28.914445 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.908676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57050 (local address 127.12.145.61:41183)
0811 06:55:28.908885 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.908891 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.909179 (+ 288us) server_negotiation.cc:407] Connection header received
0811 06:55:28.909343 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.909349 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.909470 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.909595 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:28.909974 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.911193 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.912566 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.913054 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.913182 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.913722 (+ 540us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:28.913858 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:28.913950 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.914097 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.914174 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260811 06:55:28.922703 19188 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:28.920743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33790 (local address 127.12.145.60:36321)
0811 06:55:28.920944 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.920949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.921243 (+ 294us) server_negotiation.cc:407] Connection header received
0811 06:55:28.921438 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.921442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.921537 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.921620 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.922467 (+ 847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33790: BlockingRecv error: recv got EOF from 127.0.0.1:33790 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 06:55:28.964505 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:28.958488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57062 (local address 127.12.145.61:41183)
0811 06:55:28.958748 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.958754 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.959038 (+ 284us) server_negotiation.cc:407] Connection header received
0811 06:55:28.959224 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.959228 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.959299 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.959377 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:28.959910 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.960761 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.962733 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:28.963241 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:28.963340 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:28.963798 (+ 458us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:28.963895 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:28.963971 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:28.964129 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 06:55:28.964196 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 06:55:28.972648 19188 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:28.970736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33802 (local address 127.12.145.60:36321)
0811 06:55:28.970971 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:28.970976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:28.971251 (+ 275us) server_negotiation.cc:407] Connection header received
0811 06:55:28.971475 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:28.971479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:28.971551 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:28.971628 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:28.972431 (+ 803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33802: BlockingRecv error: recv got EOF from 127.0.0.1:33802 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 06:55:29.029348 19212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3f593b9f91c04b668b33a832c6693e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f593b9f91c04b668b33a832c6693e15" member_type: VOTER last_known_addr { host: "127.12.145.62" port: 39883 } } peers { permanent_uuid: "4b9e2f2068074228a3f27c286dc3615e" member_type: VOTER last_known_addr { host: "127.12.145.61" port: 41183 } } peers { permanent_uuid: "cf3c729145034f8abb52f8f928abb1c4" member_type: VOTER last_known_addr { host: "127.12.145.60" port: 36321 } } }
I20260811 06:55:29.029692 19212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f593b9f91c04b668b33a832c6693e15 [sys.catalog]: This master's current role is: LEADER
I20260811 06:55:29.046250 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:29.040171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57072 (local address 127.12.145.61:41183)
0811 06:55:29.040368 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:29.040375 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:29.040924 (+ 549us) server_negotiation.cc:407] Connection header received
0811 06:55:29.041109 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:29.041113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:29.041202 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:29.041297 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:29.041787 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.042613 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.044269 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.044921 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.045060 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:29.045530 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:29.045669 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:29.045744 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:29.045890 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 06:55:29.045978 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 06:55:29.053701 19188 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:55:29.051996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33804 (local address 127.12.145.60:36321)
0811 06:55:29.052169 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:29.052174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:29.052453 (+ 279us) server_negotiation.cc:407] Connection header received
0811 06:55:29.052597 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:29.052603 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:29.052687 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:29.052774 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 06:55:29.053428 (+ 654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33804: BlockingRecv error: recv got EOF from 127.0.0.1:33804 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 06:55:29.167959 19208 catalog_manager.cc:1259] Loaded cluster ID: 1438abd0f6964a32a1e72c92224021ed
I20260811 06:55:29.168062 19208 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4: loading cluster ID for follower catalog manager: success
I20260811 06:55:29.170730 19208 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4: acquiring CA information for follower catalog manager: success
I20260811 06:55:29.172515 19208 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cf3c729145034f8abb52f8f928abb1c4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 06:55:29.189802 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:29.184704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57078 (local address 127.12.145.61:41183)
0811 06:55:29.184907 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:29.184914 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:29.185267 (+ 353us) server_negotiation.cc:407] Connection header received
0811 06:55:29.185468 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:29.185472 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:29.185592 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:29.185676 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:29.186084 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.186759 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.188152 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.188570 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.188680 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:29.189088 (+ 408us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:29.189207 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:29.189284 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:29.189436 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 06:55:29.189541 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 06:55:29.199651 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:29.194677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33820 (local address 127.12.145.60:36321)
0811 06:55:29.194908 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:29.194914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:29.195141 (+ 227us) server_negotiation.cc:407] Connection header received
0811 06:55:29.195280 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:29.195284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:29.195429 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:29.195533 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:29.195843 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.196553 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.197789 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.198168 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.198253 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:29.198673 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:29.199173 (+ 500us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:29.199277 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:29.199322 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 06:55:29.199385 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 06:55:29.212718 19488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:29.204579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49558 (local address 127.12.145.62:39883)
0811 06:55:29.206043 (+ 1464us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:29.206048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:29.206066 (+ 18us) server_negotiation.cc:407] Connection header received
0811 06:55:29.206162 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:29.206165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:29.206310 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:29.206456 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:29.207121 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.208154 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.210086 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.210668 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.210775 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:29.211379 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:29.211816 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:29.211938 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:29.212328 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 06:55:29.212413 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1345,"thread_start_us":1236,"threads_started":1}
I20260811 06:55:29.212863 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:29.204752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57094 (local address 127.12.145.61:41183)
0811 06:55:29.204935 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:29.204956 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:29.207132 (+ 2176us) server_negotiation.cc:407] Connection header received
0811 06:55:29.207400 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:29.207407 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:29.207494 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:29.207586 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:29.208122 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.208917 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.210951 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.211528 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.211646 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:29.212128 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:29.212258 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:29.212323 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:29.212538 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 06:55:29.212634 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 06:55:29.214226 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 06:55:29.205885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33834 (local address 127.12.145.60:36321)
0811 06:55:29.206042 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 06:55:29.206048 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 06:55:29.207473 (+ 1425us) server_negotiation.cc:407] Connection header received
0811 06:55:29.207677 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 06:55:29.207682 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 06:55:29.207754 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 06:55:29.207801 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 06:55:29.208495 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.209509 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.211434 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 06:55:29.211919 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 06:55:29.212042 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 06:55:29.213337 (+ 1295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 06:55:29.213447 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 06:55:29.213568 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 06:55:29.213703 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 06:55:29.213783 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 06:55:29.217152 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18802
I20260811 06:55:29.218160 18894 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:55:29.329559 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 18802
I20260811 06:55:29.358276 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 18914
I20260811 06:55:29.359419 19030 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:55:29.463801 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 18914
I20260811 06:55:29.487705 12868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu pid 19053
I20260811 06:55:29.488896 19173 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:55:29.597591 12868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuXC_ag/build/asan/bin/kudu with pid 19053
2026-08-11T06:55:29Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4600 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9780 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (403988 ms total)
[ PASSED ] 54 tests.
[ FAILED ] 2 tests, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
2 FAILED TESTS